-- Logs begin at Thu 2022-06-02 12:26:08 UTC, end at Thu 2022-06-02 13:47:08 UTC. -- Jun 02 13:11:04.678163 dv-cinder-797608-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:11:04.687081 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:11:04 2022] *** Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: nodename: dv-cinder-797608-26-iscsi Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: machine: x86_64 Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: clock source: unix Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: pcre jit disabled Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: detected number of CPU cores: 4 Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: current working directory: / Jun 02 13:11:04.689868 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: your processes number limit is 47680 Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: your memory page size is 4096 bytes Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: detected max file descriptor number: 2048 Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: lock engine: pthread robust mutexes Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: thunder lock: enabled Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:11:04.690503 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:11:04.735867 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: Python main interpreter initialized at 0x55727e00f9c0 Jun 02 13:11:04.735867 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: python threads support enabled Jun 02 13:11:04.735867 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: your server socket listen backlog is limited to 100 connections Jun 02 13:11:04.735867 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:11:04.736237 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:11:04.736311 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: *** Operational MODE: preforking *** Jun 02 13:11:04.736548 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:11:04.736548 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: spawned uWSGI master process (pid: 103689) Jun 02 13:11:04.736739 dv-cinder-797608-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:11:04.738212 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: spawned uWSGI worker 1 (pid: 103690, cores: 1) Jun 02 13:11:04.738212 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: spawned uWSGI worker 2 (pid: 103691, cores: 1) Jun 02 13:11:04.738212 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:11:05.947172 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:11:05.948794 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:11:06.658798 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:11:06.658798 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: from cryptography.utils import int_from_bytes Jun 02 13:11:06.659057 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:11:06.659057 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: from cryptography.utils import int_from_bytes Jun 02 13:11:06.662210 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:11:06.662210 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: from cryptography.utils import int_from_bytes Jun 02 13:11:06.662547 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:11:06.662547 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: from cryptography.utils import int_from_bytes Jun 02 13:11:09.226308 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:11:09.226881 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:11:09.227063 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:11:09.227417 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:11:09.227673 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:11:09.228597 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.228809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:11:09.229162 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.229250 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:11:09.229335 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.229519 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.229617 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:11:09.229845 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.229932 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:11:09.230152 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.230243 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:11:09.230472 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.230598 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.230788 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.230885 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.231109 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.231201 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.231365 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.231466 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.231948 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232050 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232273 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-26-iscsi {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232362 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232590 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232685 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232894 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.232980 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233201 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233287 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233502 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233587 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233801 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.233885 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234126 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234226 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-26-iscsi {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234430 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234516 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234736 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.234917 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235053 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235355 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235533 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235685 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235824 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.235989 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236214 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236344 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236424 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236600 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236772 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.236905 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237083 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237219 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237386 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237521 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237693 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.237869 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238026 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238156 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238339 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238510 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-26-iscsi {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238647 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238821 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.238983 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239130 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239274 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239438 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239596 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239846 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.239993 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240178 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240314 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-26-iscsi {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240481 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240628 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240809 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.240973 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241116 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241242 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241416 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241652 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241746 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.241963 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242056 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242270 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242363 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242589 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242680 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.242912 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.243003 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.243213 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.243305 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244111 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244218 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244437 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244741 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.244870 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245040 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245127 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245286 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245373 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245588 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245682 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245904 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.245996 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246218 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246312 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246522 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246617 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246767 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.246861 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247012 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247105 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247323 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247420 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247638 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247732 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.247969 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248057 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248275 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248375 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248525 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248610 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248774 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.248869 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249091 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249176 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249407 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249504 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249714 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.249808 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250011 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250095 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250313 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250406 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250617 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250711 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.250920 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251008 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251219 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251306 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251519 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251613 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251822 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.251959 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252161 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252255 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252461 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252558 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252781 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.252865 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253085 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253172 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253386 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253474 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253698 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.253790 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254016 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254102 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254317 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254404 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254617 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254711 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.254916 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255012 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255227 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255321 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255542 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255629 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255840 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.255957 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256111 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256243 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256406 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256548 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256705 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.256851 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257018 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257167 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257321 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257488 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257621 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257788 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.257922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258035 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258218 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258334 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258518 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258634 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258817 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.258950 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259141 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259280 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259441 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259585 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259743 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.259914 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260065 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260217 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260366 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260522 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260666 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260826 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.260965 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261129 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261278 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261438 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261593 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261741 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.261890 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262042 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262189 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262345 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262489 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262646 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262788 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.262947 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263115 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263261 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263385 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263579 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263672 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.263919 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264023 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264214 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264300 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264515 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264618 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264818 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.264915 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265136 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265227 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265440 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265526 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265741 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.265835 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266043 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266134 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266343 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266429 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266641 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266734 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.266941 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267033 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267240 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267326 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267537 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267623 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267835 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.267941 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268155 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268241 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268452 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268540 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268748 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.268833 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269047 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269139 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269340 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269439 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269638 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269724 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.269938 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270024 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270237 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270335 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270628 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270832 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.270918 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.271131 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.271218 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.271433 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.271519 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.271747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.271845 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.272087 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.272175 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.272394 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.272479 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.272696 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.272802 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.272998 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.273085 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.273314 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:11:09.273399 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.273623 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.273719 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.273931 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274016 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274257 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274341 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274564 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274662 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274901 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.274993 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275206 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275291 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275518 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275611 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275827 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.275978 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276174 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276266 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276485 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276571 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276795 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.276882 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277105 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277200 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277409 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277496 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277718 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.277812 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278031 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278116 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278344 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278439 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278651 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278734 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.278982 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.279402 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.279856 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280009 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280228 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280324 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280549 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280643 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280870 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.280957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.281203 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.281291 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.281529 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.281668 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.281842 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282069 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282189 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282464 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282550 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282819 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.282906 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283157 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283241 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283480 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283606 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283796 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.283942 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284134 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284266 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284449 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284587 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284772 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.284907 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285110 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285235 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285425 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285587 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285744 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.285952 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286045 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286305 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286391 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286631 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286725 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.286957 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287041 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287271 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287358 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287607 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287695 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.287948 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288040 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288267 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288366 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288582 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288670 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288900 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.288986 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289215 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289313 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289528 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289614 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289840 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.289926 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.290148 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.290240 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.290980 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291073 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291287 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291371 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291596 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291690 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.291919 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292005 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292231 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292317 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292536 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292631 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292847 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.292934 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293159 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293245 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293463 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293550 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293772 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.293855 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294082 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294168 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294384 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294477 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294689 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294775 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.294998 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295082 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295302 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295389 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295605 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295689 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.295931 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296020 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296245 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296340 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296556 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296641 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296864 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.296958 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297171 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297256 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297476 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297562 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297785 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.297878 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298095 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298179 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298404 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298490 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298715 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.298809 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299025 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299111 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299348 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299433 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299662 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299756 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.299984 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300082 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300294 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300380 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300596 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300683 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300899 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.300987 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301201 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301289 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301507 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301601 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301809 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.301902 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302110 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302195 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302411 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302504 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302711 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.302796 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303012 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303097 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303315 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303401 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303622 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303707 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.303942 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304050 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304244 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304331 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304546 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304631 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304848 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.304942 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305151 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305237 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305473 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305565 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305781 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.305900 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.306653 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.306748 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.306960 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307045 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307264 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307360 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307608 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.307935 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308023 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308265 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308352 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308572 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308665 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308879 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.308965 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309194 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309289 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309507 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309593 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309818 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.309903 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310121 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310207 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310428 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310512 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310735 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.310819 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311042 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311127 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311341 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311426 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311653 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311752 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.311991 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312101 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312300 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312395 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312628 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312722 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.312935 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313092 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313251 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313403 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313555 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313717 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.313867 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314023 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314204 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314329 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314534 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314628 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314849 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.314935 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315166 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315474 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315685 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315777 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.315856 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316102 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316193 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316411 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316718 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.316804 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317025 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317111 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317328 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317421 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317633 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317717 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.317949 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318034 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318255 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318349 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318563 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318647 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318867 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.318953 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319181 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319266 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319481 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319568 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.319895 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320116 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320203 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320418 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320506 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320716 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.320815 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321021 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321108 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321329 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321422 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321634 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321736 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.321938 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322024 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322240 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322337 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322548 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322642 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322850 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.322936 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323146 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323230 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323445 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323532 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323748 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.323834 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324079 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324165 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324384 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324471 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324697 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.324782 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325005 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325092 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325302 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325388 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325600 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325686 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325908 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.325992 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326209 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326296 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326522 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326606 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326844 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.326931 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327170 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327295 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327480 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327589 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327776 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.327950 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328119 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328252 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328428 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328565 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328731 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.328883 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329032 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329194 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329333 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329503 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329674 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329808 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.329983 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330112 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330286 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330411 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330601 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330724 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.330921 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331014 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331229 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331315 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331541 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331628 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331850 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.331964 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332181 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332267 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332507 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332595 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332821 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.332915 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333129 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333262 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333439 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333527 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333748 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.333835 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334056 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334141 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334364 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334452 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334684 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.334960 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335046 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335285 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335371 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335592 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335677 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.335910 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336000 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336223 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336311 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336533 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336628 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.336860 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337093 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337206 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337452 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337539 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337768 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.337864 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338086 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338172 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338397 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338483 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338698 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.338787 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339010 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339098 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339310 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339404 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339611 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339697 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.339930 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340096 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340238 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340334 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340537 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340624 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340838 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.340933 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341136 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341230 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341440 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341526 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341746 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.341833 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342050 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342175 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342359 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342446 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342666 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342751 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.342968 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343056 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343268 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343398 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343566 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343652 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343867 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.343974 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344191 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344287 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344518 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344643 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344801 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.344898 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345119 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345207 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345424 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345519 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345724 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.345810 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346027 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346120 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346328 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346423 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346666 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346753 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.346970 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347059 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347305 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347400 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347604 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347689 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.347930 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348021 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348240 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348329 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348538 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348633 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348846 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.348941 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349153 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349250 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349454 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349545 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349754 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.349847 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350048 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350134 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350350 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350437 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350650 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350734 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.350955 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351049 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351257 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351342 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351554 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351648 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351851 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.351970 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.352170 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.352294 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.352474 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.352579 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353260 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353356 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353582 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353676 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353880 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.353979 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354180 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354303 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354477 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354562 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354774 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.354872 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355071 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355164 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355370 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355457 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355670 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355757 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.355990 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.356091 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.356306 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.356393 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.356859 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.356953 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357155 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357247 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357453 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357539 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357755 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.357843 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358054 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358140 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358348 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358434 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358650 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358737 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.358961 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359047 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359264 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359358 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359558 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359651 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359861 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.359984 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360180 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360282 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360478 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360570 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360772 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.360866 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361074 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361168 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361371 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361458 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361666 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361760 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.361959 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362054 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362257 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362488 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362579 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362657 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362843 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.362930 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363141 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363226 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363438 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363529 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363734 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.363820 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364053 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364140 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364355 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364440 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364654 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364749 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.364972 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365059 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365277 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365363 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365577 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365664 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365880 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.365974 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366180 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366277 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366481 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366566 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366787 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.366880 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367084 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367179 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367389 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367476 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367692 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.367778 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.368024 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.368195 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.368324 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.368452 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369206 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369305 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369522 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369618 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369828 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.369914 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370142 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370229 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370454 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370572 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370766 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.370945 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371069 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371277 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371375 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371580 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371666 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371892 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.371980 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372216 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372315 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372522 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372609 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372848 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.372940 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373212 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373316 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373512 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373597 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373822 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.373916 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374131 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374234 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374438 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374567 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.374919 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375056 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375224 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375367 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375531 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.375838 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376011 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376206 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376325 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376530 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376636 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376838 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.376933 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377146 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377270 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377454 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377546 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377759 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.377865 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378067 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378161 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378367 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378461 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378731 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.378831 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379042 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379142 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379347 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379439 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379656 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379749 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.379984 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380078 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380288 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380418 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380603 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380728 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.380904 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381045 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381209 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381351 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381621 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381714 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.381928 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382020 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382234 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382371 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382566 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382726 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382872 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.382965 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.383227 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.383332 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.383581 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.383669 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.383902 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384055 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384243 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384345 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384551 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384689 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384854 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.384942 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385162 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385302 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385484 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385637 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385790 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.385959 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.386095 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.386399 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.386484 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.386720 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.386807 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387024 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387124 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387346 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387492 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387764 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.387862 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388111 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388210 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388419 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388506 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388832 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.388916 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389235 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389452 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389539 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389773 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.389859 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390096 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390213 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390419 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390519 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390724 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.390868 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391040 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391163 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391351 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391468 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391677 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.391793 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392026 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392145 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392342 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392459 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392659 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392775 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.392969 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393085 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393291 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393415 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393614 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393729 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.393935 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394057 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394245 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394362 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394704 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394826 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.394969 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.395092 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.395281 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.395397 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396027 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396112 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396205 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396289 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396422 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396511 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396590 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396753 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.396849 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397059 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397147 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397397 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397484 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397719 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.397812 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398025 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398112 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398335 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398431 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398645 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398777 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.398955 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399162 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399256 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399511 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399607 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399897 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.399998 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400205 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400293 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400525 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400625 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400840 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.400993 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.401163 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.401353 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.401482 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.401743 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.401831 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402081 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402176 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402386 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402487 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402688 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402774 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.402988 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403080 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403287 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403381 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403616 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403702 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.403938 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404083 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404261 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404357 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404589 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404706 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.404918 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405072 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405229 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405406 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405562 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405731 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.405886 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406045 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406205 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406359 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406522 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406666 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406844 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.406966 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407147 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407264 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407449 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407568 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407757 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.407879 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408083 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408173 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408386 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408473 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408688 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408782 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.408995 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409084 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409295 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409383 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409595 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409697 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409895 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.409982 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410207 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410293 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410508 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410602 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410812 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.410905 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411110 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411203 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411410 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411504 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411713 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.411802 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412037 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412158 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412377 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412511 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.412895 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413011 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413213 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413313 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413622 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413857 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.413951 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414166 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414265 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414487 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414574 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414847 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.414977 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.415161 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.415780 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416022 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416202 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416339 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416529 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416654 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416848 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.416946 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417162 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417250 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417474 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417569 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417779 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.417868 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418089 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418176 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418399 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418494 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418710 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.418965 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.419245 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.419342 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.419580 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.419676 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.419937 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420039 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420226 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420320 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420535 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420633 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420845 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.420931 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421154 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421240 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421462 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421558 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421769 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.421854 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422076 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422169 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422382 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422469 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422706 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.422793 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423024 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423119 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423346 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423434 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423664 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423757 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.423999 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424163 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424312 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424406 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424622 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424709 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.424933 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425028 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425278 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425364 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425583 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425680 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.425883 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426008 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426193 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426279 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426503 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426601 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426810 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.426897 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427116 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427204 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427420 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427512 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427732 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.427822 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428064 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428164 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428370 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428469 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428676 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428762 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.428985 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429071 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429310 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429406 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429645 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429740 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.429966 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430052 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430280 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430374 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430592 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430680 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.430941 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.431531 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.431757 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.431998 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.432301 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.432400 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.432615 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.432710 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.432944 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433033 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433265 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433351 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433582 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433676 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433894 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.433982 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434204 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434290 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434515 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434616 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434817 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.434902 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435117 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435204 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435422 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435518 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435725 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.435809 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436065 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436152 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436378 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436476 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436683 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436775 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.436981 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.437079 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.437296 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.437395 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.437599 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.437824 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438127 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438221 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438470 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438558 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438782 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.438868 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439105 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439189 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439423 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439511 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439732 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.439826 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440081 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440170 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440392 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440482 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440701 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.440787 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441016 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441108 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441326 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441415 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441630 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441717 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.441935 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442030 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442247 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442334 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442556 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442643 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442861 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.442956 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443160 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443252 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443467 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443555 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443767 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.443861 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444106 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444192 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444408 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444533 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444709 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.444805 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445008 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445095 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445310 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445396 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445609 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445696 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.445909 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446002 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446208 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446295 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446540 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446702 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446841 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.446928 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447152 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447239 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447457 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447553 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447768 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.447855 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448104 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448195 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448403 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448497 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448708 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.448804 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449061 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449162 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449365 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449451 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449668 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449756 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.449966 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450064 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450277 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450364 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450583 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450682 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450894 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.450987 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.451204 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.451291 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.451549 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.451636 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.451866 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.452000 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.452359 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.452452 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.452749 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.452981 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453078 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453347 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453441 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453666 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453759 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.453997 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454162 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454303 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454389 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454611 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454698 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.454910 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455212 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455298 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455528 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455616 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455831 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.455953 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456164 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456252 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456471 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456570 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456778 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.456866 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457083 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457170 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457388 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457482 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457693 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457787 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.457996 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458083 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458299 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458385 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458602 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458690 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.458906 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459000 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459211 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459344 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459521 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459608 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459829 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.459944 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460176 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460275 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460488 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460574 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460799 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.460884 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461108 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461206 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461415 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461500 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461719 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.461805 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462025 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462131 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462365 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462451 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462696 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.462791 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463010 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463097 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463321 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463415 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463628 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463720 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.463953 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464068 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464368 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464454 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464675 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464773 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.464989 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465076 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465302 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465388 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465608 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465705 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.465918 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466005 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466233 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466319 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466539 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466639 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466854 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.466942 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467161 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467294 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467483 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467579 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467812 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.467922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468228 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468444 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468532 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.468834 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469045 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469137 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469348 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469476 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469653 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469740 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.469957 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470044 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470256 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470343 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470556 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470643 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470854 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.470949 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471155 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471247 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471451 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471537 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471751 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.471854 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472072 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472186 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472372 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472473 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472672 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472766 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.472968 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473054 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473266 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473353 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473564 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473659 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473864 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.473959 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474161 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474253 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474459 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474546 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474760 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.474845 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475057 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475144 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475355 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475443 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475650 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475736 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.475971 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476072 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476272 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476403 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476597 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476686 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.476933 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.477027 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.477245 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.477370 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.477566 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.477653 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.478455 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.478563 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.478784 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.478910 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.479109 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.479265 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.479424 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.479643 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.479739 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480016 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480108 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480331 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480417 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480641 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480736 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.480969 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.481056 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.481277 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.481371 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.481840 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.481932 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482146 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482232 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482452 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482546 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482781 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.482866 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483088 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483176 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483413 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483574 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483735 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.483830 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484079 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484168 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484397 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484493 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484709 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.484796 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485039 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485133 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485351 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485439 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485660 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485799 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.485974 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486098 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486282 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486375 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486586 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486673 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486895 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.486982 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487201 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487295 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487508 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487597 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487818 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.487961 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488155 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488242 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488478 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488565 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488798 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.488895 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489104 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489191 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489430 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489516 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489750 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.489849 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490085 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490177 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490392 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490478 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490703 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.490791 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.491010 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.491096 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.491254 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:11:09.491349 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.491628 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.491958 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:11:09.492199 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:11:09.549990 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Registered counter for database nova_api Jun 02 13:11:09.550466 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO dbcounter [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Registered counter for database nova_api Jun 02 13:11:09.571014 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.574599 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.580062 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.581844 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writer thread running {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.636027 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.context [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1df06762-053d-4fa1-85a6-089ccc3e3199(cell1) {{(pid=103691) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:11:09.637421 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.context [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1df06762-053d-4fa1-85a6-089ccc3e3199(cell1) {{(pid=103690) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:11:09.640152 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:11:09.641642 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_concurrency.lockutils [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:11:09.641765 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:11:09.642474 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:11:09.643197 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_concurrency.lockutils [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:11:09.644007 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_concurrency.lockutils [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:11:09.644422 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:11:09.645927 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_concurrency.lockutils [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:11:09.646681 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Registered counter for database nova_cell0 Jun 02 13:11:09.647934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO dbcounter [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Registered counter for database nova_cell0 Jun 02 13:11:09.650920 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Registered counter for database nova_cell1 Jun 02 13:11:09.652366 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO dbcounter [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Registered counter for database nova_cell1 Jun 02 13:11:09.657976 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.660163 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.661171 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.663738 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.663855 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.669591 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writer thread running {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.672265 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writer thread running {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.806135 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.814671 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Registered counter for database nova_cell0 Jun 02 13:11:09.821455 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.822319 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO dbcounter [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Registered counter for database nova_cell0 Jun 02 13:11:09.825995 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:09.828868 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:11:09.833211 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writer thread running {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:11:10.332225 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:11:10.340186 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:11:10.370023 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: WARNING keystonemiddleware.auth_token [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:11:10.377724 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: WARNING keystonemiddleware.auth_token [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:11:10.562253 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:11:10.568303 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:11:10.574074 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55727e00f9c0 pid: 103691 (default app) Jun 02 13:11:10.576403 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:11:10.577576 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jun 02 13:11:10.577975 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Jun 2 13:11:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:11:10.609107 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: WARNING keystonemiddleware.auth_token [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:11:10.615146 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: WARNING keystonemiddleware.auth_token [None req-c0b4d2ef-a452-499e-ad06-5b1399636a7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:11:10.621022 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55727e00f9c0 pid: 103690 (default app) Jun 02 13:12:31.525543 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:31.527186 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002289 Jun 02 13:12:31.527986 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:31.547027 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_api:SELECT=3 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:31.549144 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_cell1:SELECT=3 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:31.551084 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_cell0:SELECT=3 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:31.552682 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:32.107260 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-86b6de30-8474-4408-8a2e-3f4b9421a8c4 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:32.142690 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-86b6de30-8474-4408-8a2e-3f4b9421a8c4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.606292 Jun 02 13:12:32.143612 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 2 13:12:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:34.614340 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:34.615336 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9285b69f-fdc1-4830-bf29-96ed87ef4cd8 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 02 13:12:34.616508 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:34.681318 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-10794ae8-1296-4e98-a89b-5db69cb984b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:34.700176 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:12:34.700176 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: warnings.warn(msg) Jun 02 13:12:34.795974 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-10794ae8-1296-4e98-a89b-5db69cb984b7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173209 Jun 02 13:12:34.796586 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:12:34.810704 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:34.811648 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell0:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:34.812685 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell1:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:34.813407 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:35.018241 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-3f22581c-d1ee-43d7-a1b7-3648908dc9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:35.020759 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:12:35.020759 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:12:35.114420 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-3f22581c-d1ee-43d7-a1b7-3648908dc9eb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308698 Jun 02 13:12:35.115207 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 2 13:12:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:37.473369 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-10794ae8-1296-4e98-a89b-5db69cb984b7 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:37.474318 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-10794ae8-1296-4e98-a89b-5db69cb984b7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 02 13:12:37.475518 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:37.580250 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5f8ad440-2d2d-479b-850b-87ac2a444b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:37.598579 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:12:37.598579 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:12:37.689590 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5f8ad440-2d2d-479b-850b-87ac2a444b35 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.207744 Jun 02 13:12:37.690142 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:12:37.702317 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-f14a16a0-6bd3-4609-9c8b-092b5f71b0d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:37.703807 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:12:37.703807 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: warnings.warn(msg) Jun 02 13:12:37.803865 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-f14a16a0-6bd3-4609-9c8b-092b5f71b0d7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105074 Jun 02 13:12:37.805663 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 2 13:12:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:12:40.098680 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5f8ad440-2d2d-479b-850b-87ac2a444b35 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:40.099726 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5f8ad440-2d2d-479b-850b-87ac2a444b35 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 02 13:12:40.100202 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:40.165206 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-b10c665f-88b7-4d03-994a-5d82d7691acf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:40.272779 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-b10c665f-88b7-4d03-994a-5d82d7691acf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165616 Jun 02 13:12:40.273455 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:12:40.285180 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-56d59e14-a0ad-483d-a103-2250478523d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:40.351193 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-56d59e14-a0ad-483d-a103-2250478523d4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069715 Jun 02 13:12:40.359907 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 2 13:12:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:42.695008 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-b10c665f-88b7-4d03-994a-5d82d7691acf admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:42.696129 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-b10c665f-88b7-4d03-994a-5d82d7691acf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 02 13:12:42.697250 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:42.759271 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-1046fa43-9d5f-4c72-ad45-dea043ed4f34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "name": "ds2G", "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:42.819446 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-1046fa43-9d5f-4c72-ad45-dea043ed4f34 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.115584 Jun 02 13:12:42.820359 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:12:42.833349 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-d64db91a-1085-4e1f-ac21-f8312f4ca792 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:42.892317 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-d64db91a-1085-4e1f-ac21-f8312f4ca792 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062425 Jun 02 13:12:42.892827 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 2 13:12:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:45.226428 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-1046fa43-9d5f-4c72-ad45-dea043ed4f34 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:45.227430 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-1046fa43-9d5f-4c72-ad45-dea043ed4f34 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 02 13:12:45.227824 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:45.288363 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "vcpus": 4}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:45.358283 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.124105 Jun 02 13:12:45.359148 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:12:45.371357 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-20156b83-dcb5-41bd-8415-44c1a04c8693 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:45.482605 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-20156b83-dcb5-41bd-8415-44c1a04c8693 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114730 Jun 02 13:12:45.483120 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 2 13:12:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:47.778397 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:47.779413 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 02 13:12:47.780111 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:47.839487 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-15b4745f-84a0-4983-933a-a105ae470d46 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:47.864807 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-15b4745f-84a0-4983-933a-a105ae470d46 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078496 Jun 02 13:12:47.865365 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 2 13:12:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:12:50.201049 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:50.202101 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-77db55f4-1178-495b-913c-4912b81645de admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 02 13:12:50.202518 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:12:50.265822 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e40ddaa8-a567-42df-ae1f-4a9caa55a44f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:50.410614 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e40ddaa8-a567-42df-ae1f-4a9caa55a44f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.201882 Jun 02 13:12:50.411304 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:12:50.424658 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-327e9618-2553-49b1-b22c-a087aef9f61f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:50.498528 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-327e9618-2553-49b1-b22c-a087aef9f61f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077854 Jun 02 13:12:50.499147 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 2 13:12:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:52.888712 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e40ddaa8-a567-42df-ae1f-4a9caa55a44f admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:52.890693 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e40ddaa8-a567-42df-ae1f-4a9caa55a44f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002676 Jun 02 13:12:52.891562 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:52.953528 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a0d5d4da-cb59-40a2-bcc5-48aed1cecff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "disk": 20}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:53.055515 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a0d5d4da-cb59-40a2-bcc5-48aed1cecff7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.157946 Jun 02 13:12:53.056097 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:12:53.068979 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-486b6344-6d01-45c1-a713-12ba7878a816 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:53.150734 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-486b6344-6d01-45c1-a713-12ba7878a816 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085693 Jun 02 13:12:53.151331 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 2 13:12:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:12:55.783041 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a0d5d4da-cb59-40a2-bcc5-48aed1cecff7 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:55.784101 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a0d5d4da-cb59-40a2-bcc5-48aed1cecff7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 02 13:12:55.784497 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:55.844152 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-d95b728c-6a3e-4f6f-b86c-abe23dd52b84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "id": "3"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:55.963666 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-d95b728c-6a3e-4f6f-b86c-abe23dd52b84 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.173327 Jun 02 13:12:55.964260 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:12:55.976098 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-f34f127c-bc56-4cdf-af2a-5ed7c2629872 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:56.201111 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-f34f127c-bc56-4cdf-af2a-5ed7c2629872 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.228733 Jun 02 13:12:56.201729 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 2 13:12:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:12:58.500185 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-d95b728c-6a3e-4f6f-b86c-abe23dd52b84 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:12:58.501199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-d95b728c-6a3e-4f6f-b86c-abe23dd52b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 02 13:12:58.501604 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:12:58.560228 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-5198e641-6336-4d57-9432-ede5fd5a47c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:58.636626 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-5198e641-6336-4d57-9432-ede5fd5a47c6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.129192 Jun 02 13:12:58.637173 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:12:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:12:58.651847 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9c39bde8-fcf2-4057-92aa-f45467206046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:12:58.751725 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9c39bde8-fcf2-4057-92aa-f45467206046 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106428 Jun 02 13:12:58.752653 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 2 13:12:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:13:01.152778 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-5198e641-6336-4d57-9432-ede5fd5a47c6 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:01.154007 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-5198e641-6336-4d57-9432-ede5fd5a47c6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jun 02 13:13:01.154481 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:01.219345 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:01.316754 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.156436 Jun 02 13:13:01.317597 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 2 13:13:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:13:01.329716 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-c5f37ca5-48e5-4aa0-af13-ccc1d72da43c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:01.412588 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-c5f37ca5-48e5-4aa0-af13-ccc1d72da43c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085903 Jun 02 13:13:01.424136 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 2 13:13:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:13:25.837110 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:25.838112 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 02 13:13:25.838505 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:25.849795 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:25.898857 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-876315e5-15a8-4b02-af07-5e790ddd26b7 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:25.913597 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-876315e5-15a8-4b02-af07-5e790ddd26b7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068895 Jun 02 13:13:25.914239 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 2 13:13:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:26.906301 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:26.907291 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-4cd33c03-80f6-4c91-8ca3-26022e754cf1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 02 13:13:26.907685 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:27.108269 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-32da0530-a049-4434-9530-e98b9d132bf7 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:27.113870 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.wsgi [None req-32da0530-a049-4434-9530-e98b9d132bf7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-32da0530-a049-4434-9530-e98b9d132bf7 admin admin] Request method failure captured: Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept: application/json Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept-Encoding: gzip, deflate Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Connection: keep-alive Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Content-Length: 0 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Host: 10.222.0.46 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-System-Scope: None Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: User-Agent: python-novaclient Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Auth-Token: gAAAAABimLd2OhrcwcGRY-0qK59IPmwSCUkJO-Aw482ExcGR86uZMDjgQSRx32XSGzVl3q0A1LPQILvK1ksDE-D7GMlZcH327aPwseuXfCN7o7rIgw2jalB0ZtOFKCXRwaSmnLvQzVeuGVsVCk-w3vbmrYxjA9FZhov5Q-e9M7mNWzJcjQGY_io Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Id: None Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Name: None Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Identity-Status: Confirmed Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Is-Admin-Project: True Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Id: default Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Name: Default Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Name: admin Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Role: member,reader,admin Jun 02 13:13:27.117694 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Roles: member,reader,admin Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant: admin Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Name: admin Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User: admin Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Id: default Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Name: Default Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Name: admin Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: method: > Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: exception: Flavor 42 could not be found. Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: action_args: {'id': '42'} Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:27.119375 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:27.120498 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.121957 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-32da0530-a049-4434-9530-e98b9d132bf7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:27.123232 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-32da0530-a049-4434-9530-e98b9d132bf7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062485 Jun 02 13:13:27.123232 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 2 13:13:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:27.128734 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-76bc91d0-39a2-4729-ab75-0b0a89e7d722 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:27.132334 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:27.150545 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-76bc91d0-39a2-4729-ab75-0b0a89e7d722 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025366 Jun 02 13:13:27.151083 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:27.168298 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-15eda2eb-1424-439b-979a-e82f1fbd2fb3 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:27.189819 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-15eda2eb-1424-439b-979a-e82f1fbd2fb3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025453 Jun 02 13:13:27.197047 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:27.205344 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9c29a402-e3c0-4e93-9186-243a74234283 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:27.211409 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-9c29a402-e3c0-4e93-9186-243a74234283 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9c29a402-e3c0-4e93-9186-243a74234283 admin admin] Request method failure captured: Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Host: 10.222.0.46 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABimLd2OhrcwcGRY-0qK59IPmwSCUkJO-Aw482ExcGR86uZMDjgQSRx32XSGzVl3q0A1LPQILvK1ksDE-D7GMlZcH327aPwseuXfCN7o7rIgw2jalB0ZtOFKCXRwaSmnLvQzVeuGVsVCk-w3vbmrYxjA9FZhov5Q-e9M7mNWzJcjQGY_io Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Role: member,reader,admin Jun 02 13:13:27.214655 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Roles: member,reader,admin Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User: admin Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: method: > Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: exception: Flavor 42 could not be found. Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: action_args: {'id': '42'} Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:27.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:27.220489 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:27.222003 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9c29a402-e3c0-4e93-9186-243a74234283 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:27.223008 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9c29a402-e3c0-4e93-9186-243a74234283 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014557 Jun 02 13:13:27.223008 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 2 13:13:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 02 13:13:28.076952 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-15eda2eb-1424-439b-979a-e82f1fbd2fb3 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:28.078037 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-15eda2eb-1424-439b-979a-e82f1fbd2fb3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 02 13:13:28.078434 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:28.267012 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-3c45cd04-6c0b-4c1a-b627-9fe0c14c475c admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:28.272190 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-3c45cd04-6c0b-4c1a-b627-9fe0c14c475c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-3c45cd04-6c0b-4c1a-b627-9fe0c14c475c admin admin] Request method failure captured: Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Host: 10.222.0.46 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABimLd4MNleG-7V1x7BO3WrRYN3xca3sR0vtEDwkmbVvlIENhOaf3SosxdF_6MJDhTpsLdhoeAn1VISICdGOk7uD_VomEjSbk2kpUAWPIpM-7uEClXTVUe4HnfnbjtMvUs5jis7rC6ipLjglZyIdfRP97ZME9XV469l9wj7nGq20XkcIsI Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Role: member,reader,admin Jun 02 13:13:28.273678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Roles: member,reader,admin Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User: admin Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: method: > Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: exception: Flavor 84 could not be found. Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: action_args: {'id': '84'} Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:28.275141 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:28.276231 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.277747 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-3c45cd04-6c0b-4c1a-b627-9fe0c14c475c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:28.279037 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-3c45cd04-6c0b-4c1a-b627-9fe0c14c475c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059997 Jun 02 13:13:28.279037 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 2 13:13:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:28.284754 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-890ba6bf-d1cc-4950-809a-a16b9b18ed08 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:28.298738 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-890ba6bf-d1cc-4950-809a-a16b9b18ed08 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017510 Jun 02 13:13:28.299199 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:28.308706 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-ff625503-9f1d-482a-b589-766ce9391281 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:28.322391 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-ff625503-9f1d-482a-b589-766ce9391281 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017139 Jun 02 13:13:28.322905 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:28.331645 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-61e4477f-5031-45f5-8e0a-4c12ba99d3fc admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:28.337445 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.wsgi [None req-61e4477f-5031-45f5-8e0a-4c12ba99d3fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-61e4477f-5031-45f5-8e0a-4c12ba99d3fc admin admin] Request method failure captured: Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept: application/json Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept-Encoding: gzip, deflate Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Connection: keep-alive Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Content-Length: 0 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Host: 10.222.0.46 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-System-Scope: None Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: User-Agent: python-novaclient Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Auth-Token: gAAAAABimLd4MNleG-7V1x7BO3WrRYN3xca3sR0vtEDwkmbVvlIENhOaf3SosxdF_6MJDhTpsLdhoeAn1VISICdGOk7uD_VomEjSbk2kpUAWPIpM-7uEClXTVUe4HnfnbjtMvUs5jis7rC6ipLjglZyIdfRP97ZME9XV469l9wj7nGq20XkcIsI Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Id: None Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Name: None Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Identity-Status: Confirmed Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Is-Admin-Project: True Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Id: default Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Name: Default Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Name: admin Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Role: member,reader,admin Jun 02 13:13:28.338934 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Roles: member,reader,admin Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant: admin Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Name: admin Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User: admin Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Id: default Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Name: Default Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Name: admin Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: method: > Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: exception: Flavor 84 could not be found. Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: action_args: {'id': '84'} Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:28.340534 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:28.341654 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:28.342922 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-61e4477f-5031-45f5-8e0a-4c12ba99d3fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:28.344237 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-61e4477f-5031-45f5-8e0a-4c12ba99d3fc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012081 Jun 02 13:13:28.344237 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 2 13:13:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:29.192010 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-ff625503-9f1d-482a-b589-766ce9391281 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:29.193083 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-ff625503-9f1d-482a-b589-766ce9391281 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 02 13:13:29.193609 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:29.381946 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-3c83d0b3-35b9-46d4-80f5-5aab4fe49d4f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:29.387762 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.wsgi [None req-3c83d0b3-35b9-46d4-80f5-5aab4fe49d4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-3c83d0b3-35b9-46d4-80f5-5aab4fe49d4f admin admin] Request method failure captured: Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept: application/json Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Accept-Encoding: gzip, deflate Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Connection: keep-alive Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Content-Length: 0 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Host: 10.222.0.46 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Openstack-System-Scope: None Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: User-Agent: python-novaclient Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Auth-Token: gAAAAABimLd5qwLOUlhdJk0HLgVrN0Td4dsBuslE3BmH9DOaVIAdJpG7tBdA9f7uta7nALGA9LTHy9odaT82CDf87RU7uep0eAw5NFuX_APejWKZC6t6exk5PnNuHCeucKvKw5js2b6JcZaJ-KwSbcknQ37pDPRdnLSgQoJ1_KRGzVszQ0DOC5U Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Id: None Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Domain-Name: None Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Identity-Status: Confirmed Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Is-Admin-Project: True Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Id: default Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Domain-Name: Default Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Project-Name: admin Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Role: member,reader,admin Jun 02 13:13:29.389253 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Roles: member,reader,admin Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant: admin Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-Tenant-Name: admin Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User: admin Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Id: default Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Domain-Name: Default Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: X-User-Name: admin Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: method: > Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: exception: Flavor 451 could not be found. Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: action_args: {'id': '451'} Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:29.390783 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:29.391669 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.393006 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-3c83d0b3-35b9-46d4-80f5-5aab4fe49d4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:29.394204 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-3c83d0b3-35b9-46d4-80f5-5aab4fe49d4f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060282 Jun 02 13:13:29.394204 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:13:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:29.400750 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-0eedc24f-e15e-4b93-b3cf-4ec71b9382a3 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:29.414753 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-0eedc24f-e15e-4b93-b3cf-4ec71b9382a3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017498 Jun 02 13:13:29.415224 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:13:29.424389 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:29.437687 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016806 Jun 02 13:13:29.438202 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 2 13:13:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:13:29.447563 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-b5d169a9-4b3e-4efb-b6eb-f82d59545374 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:29.452822 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-b5d169a9-4b3e-4efb-b6eb-f82d59545374 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-b5d169a9-4b3e-4efb-b6eb-f82d59545374 admin admin] Request method failure captured: Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Host: 10.222.0.46 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABimLd5qwLOUlhdJk0HLgVrN0Td4dsBuslE3BmH9DOaVIAdJpG7tBdA9f7uta7nALGA9LTHy9odaT82CDf87RU7uep0eAw5NFuX_APejWKZC6t6exk5PnNuHCeucKvKw5js2b6JcZaJ-KwSbcknQ37pDPRdnLSgQoJ1_KRGzVszQ0DOC5U Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Role: member,reader,admin Jun 02 13:13:29.454299 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Roles: member,reader,admin Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4046aee9673645e2803f9186d9e29f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4046aee9673645e2803f9186d9e29f17"}]}] Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Id: 4046aee9673645e2803f9186d9e29f17 Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User: admin Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Id: ac80ec2c07774b5581b987e15cf3a2d3 Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: method: > Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: exception: Flavor 451 could not be found. Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: action_args: {'id': '451'} Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:13:29.455809 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:29.456857 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 02 13:13:29.458199 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-b5d169a9-4b3e-4efb-b6eb-f82d59545374 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:13:29.460052 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-b5d169a9-4b3e-4efb-b6eb-f82d59545374 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011562 Jun 02 13:13:29.460052 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:13:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:30.316617 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:30.317617 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 02 13:13:30.318040 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:30.506088 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-f8dacc71-ad43-44ff-81ec-f414830e471f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:30.577935 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-f8dacc71-ad43-44ff-81ec-f414830e471f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122719 Jun 02 13:13:30.578478 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 2 13:13:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:13:31.442855 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:31.443893 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 02 13:13:31.444289 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:31.631194 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-2b93a9b0-d6e3-476b-9412-95dbdfe1aec4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:31.744039 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-2b93a9b0-d6e3-476b-9412-95dbdfe1aec4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.164656 Jun 02 13:13:31.746288 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 2 13:13:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:13:32.608930 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:32.609932 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 02 13:13:32.610329 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:32.798461 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9df57054-4276-4058-9884-d44927b82e3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:32.898055 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9df57054-4276-4058-9884-d44927b82e3c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.150964 Jun 02 13:13:32.898594 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 2 13:13:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:13:33.761143 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:33.762173 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 02 13:13:33.762565 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:33.950663 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-440ddd82-0d6c-47c1-ba41-58225a5e31e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:13:34.034989 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-440ddd82-0d6c-47c1-ba41-58225a5e31e7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134855 Jun 02 13:13:34.035499 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 2 13:13:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:13:34.900337 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:34.902762 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 02 13:13:34.902762 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:13:35.088152 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a66cc063-8872-4867-a77b-4ec19cefa9d5 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:13:35.107688 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a66cc063-8872-4867-a77b-4ec19cefa9d5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071426 Jun 02 13:13:35.108245 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jun 2 13:13:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:14:37.137578 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.138578 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-940b0bbe-3a75-4574-8925-b4901024e77f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 02 13:14:37.138973 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:14:37.146995 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:14:37.199257 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-76e29efb-5606-4f3e-98bd-4b433a65024c admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.218608 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-76e29efb-5606-4f3e-98bd-4b433a65024c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073049 Jun 02 13:14:37.219149 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:14:37.239749 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG dbcounter [-] [103690] Writing DB stats nova_api:SELECT=14 {{(pid=103690) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:14:37.243608 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-5368d105-c3b8-4b53-9c19-2ad895f3ef51 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.251033 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-5368d105-c3b8-4b53-9c19-2ad895f3ef51 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012702 Jun 02 13:14:37.251547 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:14:37.263246 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-0ef07ba5-5485-4d6c-816c-96ab54ccbf86 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.271969 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-0ef07ba5-5485-4d6c-816c-96ab54ccbf86 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012195 Jun 02 13:14:37.272512 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:14:37.286557 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.294200 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013290 Jun 02 13:14:37.294712 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:14:37.306690 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-4ed5bc84-1fc4-4baa-8d64-62760c070c92 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:14:37.315196 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-4ed5bc84-1fc4-4baa-8d64-62760c070c92 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012179 Jun 02 13:14:37.315720 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jun 2 13:14:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:18:13.208866 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:13.209893 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 02 13:18:13.210280 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:18:13.367765 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=6 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:13.483549 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:13.484783 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:18:13.484783 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:18:13.485966 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:13.486401 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:13.487186 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:13.487608 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:13.521321 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-b7b9f4eb-57c4-4212-a1de-4d67e28330da admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155099 Jun 02 13:18:13.521881 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:18:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:18:14.401866 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:14.402877 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 02 13:18:14.403271 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:18:14.596826 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:14.598188 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:18:14.598188 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:18:14.599403 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:14.599893 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:14.600720 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:14.601140 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:14.622856 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-0690f9cf-d855-4487-aae4-1d12cd4cf147 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078171 Jun 02 13:18:14.623348 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:18:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:18:25.900226 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:25.901352 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 02 13:18:25.901748 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:18:26.044337 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell0:SELECT=4 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:26.045068 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell1:SELECT=4 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:26.045678 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=8 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:26.107304 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-963013bf-d201-4655-815f-192762baa79d admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:26.108567 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:18:26.108567 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:18:26.109823 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-963013bf-d201-4655-815f-192762baa79d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:26.110272 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-963013bf-d201-4655-815f-192762baa79d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:26.111057 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-963013bf-d201-4655-815f-192762baa79d admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:26.111514 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-963013bf-d201-4655-815f-192762baa79d admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:26.137247 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-963013bf-d201-4655-815f-192762baa79d admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.097166 Jun 02 13:18:26.137846 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:18:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:18:27.020873 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: DEBUG nova.api.openstack.wsgi [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] Calling method '>' {{(pid=103690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:27.021899 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: INFO nova.api.openstack.requestlog [None req-a6662bef-aadd-488f-a6c9-24793a8ee803 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 02 13:18:27.022263 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: [pid: 103690|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 2 13:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:18:27.211742 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:18:27.213015 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:18:27.213015 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 02 13:18:27.214292 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:27.214805 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:27.215617 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:18:27.216106 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:18:27.240572 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-d0d5d49d-be7a-4f3a-95d6-09871c504a3a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078959 Jun 02 13:18:27.240572 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 2 13:18:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:19:24.102307 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: Thu Jun 2 13:19:24 2022 - graceful shutdown triggered... Jun 02 13:19:24.103339 dv-cinder-797608-26-iscsi devstack@n-api.service[103691]: Gracefully killing worker 2 (pid: 103691)... Jun 02 13:19:24.102549 dv-cinder-797608-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 13:19:24.104225 dv-cinder-797608-26-iscsi devstack@n-api.service[103690]: Gracefully killing worker 1 (pid: 103690)... Jun 02 13:19:25.103446 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: worker 1 buried after 1 seconds Jun 02 13:19:25.103446 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: worker 2 buried after 1 seconds Jun 02 13:19:25.103446 dv-cinder-797608-26-iscsi devstack@n-api.service[103689]: goodbye to uWSGI. Jun 02 13:19:25.104998 dv-cinder-797608-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 13:19:25.105568 dv-cinder-797608-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 13:19:25.108361 dv-cinder-797608-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:19:25.128982 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:19:25 2022] *** Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: nodename: dv-cinder-797608-26-iscsi Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: machine: x86_64 Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: clock source: unix Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: pcre jit disabled Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: detected number of CPU cores: 4 Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: current working directory: / Jun 02 13:19:25.151402 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: your processes number limit is 47680 Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: your memory page size is 4096 bytes Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: detected max file descriptor number: 2048 Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: lock engine: pthread robust mutexes Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: thunder lock: enabled Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:19:25.152264 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:19:25.197496 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: Python main interpreter initialized at 0x55e10a3d29c0 Jun 02 13:19:25.197496 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: python threads support enabled Jun 02 13:19:25.197496 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: your server socket listen backlog is limited to 100 connections Jun 02 13:19:25.197496 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:19:25.197941 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:19:25.197941 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: *** Operational MODE: preforking *** Jun 02 13:19:25.198178 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:19:25.198178 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: spawned uWSGI master process (pid: 118114) Jun 02 13:19:25.198387 dv-cinder-797608-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:19:25.199640 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: spawned uWSGI worker 1 (pid: 118131, cores: 1) Jun 02 13:19:25.200340 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: spawned uWSGI worker 2 (pid: 118132, cores: 1) Jun 02 13:19:25.200493 dv-cinder-797608-26-iscsi devstack@n-api.service[118114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:19:26.450688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:19:26.452122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:19:27.288282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:19:27.288282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: from cryptography.utils import int_from_bytes Jun 02 13:19:27.288623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:19:27.288623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: from cryptography.utils import int_from_bytes Jun 02 13:19:27.288805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:19:27.288805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: from cryptography.utils import int_from_bytes Jun 02 13:19:27.288970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:19:27.288970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: from cryptography.utils import int_from_bytes Jun 02 13:19:29.674499 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:19:29.675122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:19:29.675331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:19:29.675696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:19:29.675979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:19:29.676201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:19:29.676608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.676706 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:19:29.676798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.676986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:19:29.677087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.677312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.677420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:19:29.677602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:19:29.677701 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.677943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.678921 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-26-iscsi {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.679964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680574 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.680970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-26-iscsi {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681775 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.681908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.682078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.682190 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.682395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.682574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.682722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.683024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.683203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.683361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.683512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.683666 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.684181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.684381 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.684576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.684789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.684980 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.685174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.685369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.685568 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.685750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.685948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.686145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.686415 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.686611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.686804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687183 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-26-iscsi {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687561 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687759 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.687953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.688176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.688376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.688578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.688773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.688932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-26-iscsi {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.689943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690187 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.690905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691745 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.691955 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692211 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692356 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.692773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.693970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694247 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.694979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695800 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.695975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.696941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.697921 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698610 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.698889 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699018 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.699952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700723 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.700862 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701823 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.701963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702333 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.702987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.703914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.704895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.705973 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706100 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706372 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.706937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.707849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708493 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.708953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709097 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709210 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709393 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709697 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.709839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.710989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.711843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.712592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.712736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.712875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713004 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713306 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713445 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.713922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714238 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.714986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.715157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.715288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.715459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.715704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.715841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.716030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.716520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.716662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.716801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.716930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717060 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717727 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.717981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718720 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.718860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.719041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.719184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.719378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.719552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.719712 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.719854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.720095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.720238 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.720409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.720541 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.720774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:19:29.720918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.721841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.722967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.723936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726724 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.726913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727450 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.727625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728752 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728836 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.728919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729097 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729532 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.729853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730178 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.730834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.731784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732075 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.732856 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733060 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.733827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734155 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.734950 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735568 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735701 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.735893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736204 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.736970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737466 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.737932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738217 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738393 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.738845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.739967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.740912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741595 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.741998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742720 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.742860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743028 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743393 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.743993 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.744947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745720 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.745895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746045 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746654 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.746986 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747277 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.747919 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748230 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.748849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749328 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.749937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750243 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750375 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.750876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751485 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751631 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.751994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.752848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753808 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.753975 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.754930 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755383 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.755939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.756978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.757931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758423 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758555 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.758910 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.759892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760073 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760701 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.760840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761768 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.761994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762562 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.762874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763198 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.763822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764286 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.764900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.765865 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766038 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766177 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.766969 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767724 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.767913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768048 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768234 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.768991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.769922 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770098 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.770833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771477 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.771994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772360 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772448 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772599 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772696 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.772902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773016 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773215 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.773964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.774122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.774262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.774963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775302 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.775888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776214 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776365 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.776981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.777915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.778839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779462 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.779983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780606 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.780916 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.781974 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.782229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.782420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.782576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.782761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.782895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.783827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784480 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.784911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.785895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786204 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786833 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.786972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787140 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787583 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787756 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.787918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788234 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.788994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.789920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.790102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.790780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.790924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.791841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.792945 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.793895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.794961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795310 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.795846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.796996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797141 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797305 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797752 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.797928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.798990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.799943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800108 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800240 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.800869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801476 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.801953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.802936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.803864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.804992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805600 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.805929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.806879 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807183 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807491 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.807942 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.808874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809347 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.809951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810215 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.810976 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811147 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.811937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.812816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813323 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813731 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.813943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814350 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814644 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814857 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.814951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815646 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815807 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.815990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816421 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.816887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817631 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.817931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818224 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818539 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.818993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.819901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820365 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.820969 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821285 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.821883 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.822183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.822342 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.822488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.822638 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.822805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823348 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823491 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.823991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.824880 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825034 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825177 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.825893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826035 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.826928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827370 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.827977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828779 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.828983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.829998 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.830919 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.831860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832786 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.832886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.833803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.834763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835119 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835647 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.835817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.836754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.837457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.837604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.837772 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.837930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838406 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.838885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.839905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.840875 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.841096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.841535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.841652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.841799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.841956 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842698 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.842879 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.843817 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844134 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844646 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.844962 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845670 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.845910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.846953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847617 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.847848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848198 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848492 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.848807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849434 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.849966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850293 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.850910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851217 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.851972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.852191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.852341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.852519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.853967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854723 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.854981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855193 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.855916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856304 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.856881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857398 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857490 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.857811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.858948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.859928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.860835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.861890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.862840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.863780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.864904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.865971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866496 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.866913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.867132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.867363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.867478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.867692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.867851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.868811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.869985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870714 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.870954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871368 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.871929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872040 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872353 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.872876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.873923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874140 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874234 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874456 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.874904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.875849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876516 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.876811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877370 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877538 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.877913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878838 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.878940 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.879156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.879251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.879486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.879583 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.879795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880045 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.880797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881356 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881456 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.881971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882707 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.882911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.883139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.883248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.883491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.883622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.883835 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884006 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.884909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885541 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885752 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.885988 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.886978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887380 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.887931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888081 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888856 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.888950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889265 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889790 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.889901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890097 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890717 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.890832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.891967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892680 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892882 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.892974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893299 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.893894 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.894834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.895758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896005 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.896975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897823 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.897927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.898916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.899134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.899225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.899991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900105 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.900945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901291 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901516 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.901947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902464 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.902874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.903800 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904344 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904654 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904756 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.904968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905596 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.905915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906009 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.906936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.907893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908428 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.908857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909483 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909707 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.909818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910780 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.910969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911718 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.911968 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.912115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.912283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.912390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.912678 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.912793 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913013 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913333 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.913976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.914992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.915764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.915930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.916839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.917971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.918999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.919942 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920542 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.920859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.921975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922279 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922888 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.922979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.923942 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.924865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925493 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925718 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.925868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926678 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.926991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927397 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927617 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.927954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928740 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.928912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929216 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929858 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.929952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.930937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.931891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932441 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932755 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.932856 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933074 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933707 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.933799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934037 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.934987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935398 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.935968 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936393 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.936935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.937090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.937246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.937340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.937491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:19:29.937585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.937892 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.938245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.938562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.938910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.939242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.939563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.939892 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.940219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:19:29.940468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:19:29.998500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Registered counter for database nova_api Jun 02 13:19:30.001802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Registered counter for database nova_api Jun 02 13:19:30.019311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.021591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.027010 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.028744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.086821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.context [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1df06762-053d-4fa1-85a6-089ccc3e3199(cell1) {{(pid=118132) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:19:30.087621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.context [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1df06762-053d-4fa1-85a6-089ccc3e3199(cell1) {{(pid=118131) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:19:30.091903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:19:30.092029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:19:30.093540 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:19:30.093733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:19:30.094359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:19:30.094544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:19:30.096359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:19:30.096515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:19:30.098382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Registered counter for database nova_cell0 Jun 02 13:19:30.098503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Registered counter for database nova_cell0 Jun 02 13:19:30.102535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Registered counter for database nova_cell1 Jun 02 13:19:30.102948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Registered counter for database nova_cell1 Jun 02 13:19:30.110543 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.112992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.114401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.115926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.120341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.121137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.122493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.265153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.275803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Registered counter for database nova_cell0 Jun 02 13:19:30.278654 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Registered counter for database nova_cell0 Jun 02 13:19:30.283159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.288038 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:19:30.292073 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.292443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:19:30.733527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:19:30.741032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:19:30.750221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:19:30.758033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:19:30.968405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:19:30.974436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-218b2b7e-1d29-451d-889a-04043938cfc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:19:30.979568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e10a3d29c0 pid: 118132 (default app) Jun 02 13:19:30.987126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:19:30.993036 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-b2f6da37-3305-4220-af7e-b86955adaa40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:19:30.998120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e10a3d29c0 pid: 118131 (default app) Jun 02 13:20:12.893988 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:12.894827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:12.895577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:12.896602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.050144 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.052682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.053334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.054107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.233502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e5034935-760c-49b5-bb32-371314aef024 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Action: 'create', calling method: .version_select at 0x7f5a824d8310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-784139313"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:14.931791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1195339495", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "networks": [{"uuid": "6f9c19c6-7a1d-498d-bb10-052484201518"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:15.761969 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] validate_networks() for [('6f9c19c6-7a1d-498d-bb10-052484201518', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:20:16.586441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e5034935-760c-49b5-bb32-371314aef024 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.697769 Jun 02 13:20:16.587158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Thu Jun 2 13:20:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3700 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 13:20:16.601677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1bab411c-25c4-4ebd-b8f6-03d1f5834f93 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a8239f310>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:16.822416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1bab411c-25c4-4ebd-b8f6-03d1f5834f93 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.226649 Jun 02 13:20:16.823115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:16 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:17.145876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:20:17.146359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:20:17.146889 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:20:17.147819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:20:17.148448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:20:17.195760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:17.196532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:17.197328 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:17.197919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:17.243902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Getting quotas for project 7aa4ef26a34e4e35a343427df4a8f0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:17.479813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Getting quotas for user ecc1e634407749c7a64fd2c10f9a8347 and project 7aa4ef26a34e4e35a343427df4a8f0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:17.479813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:20:17.479813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:20:17.562786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d92d18b3-a0ea-460d-90f3-18ed76760b92 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.524210 Jun 02 13:20:17.563466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:20:17.574229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8102afc-72b9-4195-b3d1-31b1374adf79 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:17.575765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8102afc-72b9-4195-b3d1-31b1374adf79 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:17.720653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8102afc-72b9-4195-b3d1-31b1374adf79 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:17.749592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8102afc-72b9-4195-b3d1-31b1374adf79 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1215 microversion: 2.1 time: 0.179361 Jun 02 13:20:17.750225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:17 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:17.837483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c6849fe4-55b1-464e-8997-45e67f3580c0 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a81ada310>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:18.024490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c6849fe4-55b1-464e-8997-45e67f3580c0 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 345 microversion: 2.1 time: 0.193170 Jun 02 13:20:18.025576 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 2/5] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:17 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:18.037563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-03ad2e4c-c49c-420b-91d1-d4aef7c8c5bd tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Action: 'create', calling method: .version_select at 0x7f5a822f6ee0>, body: {"snapshot": {"volume_id": "95bf6892-e78a-4f4d-b1f7-eab2094f6021", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2035069200"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:18.768618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e2d21519-ec2b-40c1-b9b7-75d7954dbcba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:18.770429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e2d21519-ec2b-40c1-b9b7-75d7954dbcba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:18.855494 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-03ad2e4c-c49c-420b-91d1-d4aef7c8c5bd tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.822214 Jun 02 13:20:18.856597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 4/6] 10.222.0.46 () {60 vars in 1161 bytes} [Thu Jun 2 13:20:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:18.871989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-db53d52c-70bc-4fc9-aec3-7355601bdc8d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fd5e0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:18.941145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-db53d52c-70bc-4fc9-aec3-7355601bdc8d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.078887 Jun 02 13:20:18.941817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 5/7] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:18 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:18.954024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bf77cb7d-3ea8-41c4-b3c8-6dacdb1a4f14 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fdca0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:19.079524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bf77cb7d-3ea8-41c4-b3c8-6dacdb1a4f14 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.128195 Jun 02 13:20:19.086021 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 6/8] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Jun 2 13:20:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:19.092916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5cb9c8cd-3f17-4395-bb8f-de5d7b7719e6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fd8b0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:19.264379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5cb9c8cd-3f17-4395-bb8f-de5d7b7719e6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.176877 Jun 02 13:20:19.271030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 7/9] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:19 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:20:19.320798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e2d21519-ec2b-40c1-b9b7-75d7954dbcba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:19.365074 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e2d21519-ec2b-40c1-b9b7-75d7954dbcba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1215 microversion: 2.1 time: 0.601432 Jun 02 13:20:19.373377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 3/10] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:18 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1215 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:20.280721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-63f42c7a-5727-4b2d-8fd3-1bc929b767c5 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fd0d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:20.370593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-63f42c7a-5727-4b2d-8fd3-1bc929b767c5 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.098238 Jun 02 13:20:20.375195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 8/11] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:20 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:20.384419 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:20.385643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:20.402396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:20.404682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:20.405502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:20.405945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:20.862330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:20.881510 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f131461c-7e40-433d-8b89-3d6f84f0033c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1219 microversion: 2.1 time: 0.502806 Jun 02 13:20:20.885259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 4/12] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:20 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1219 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:21.382918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-126a2908-ab92-474d-a4a9-a7d2b9684118 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a82d14430>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:21.496687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-126a2908-ab92-474d-a4a9-a7d2b9684118 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.111905 Jun 02 13:20:21.496687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 9/13] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:21 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:21.901152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:21.901687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:21.921448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:21.921899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:21.922676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:21.923323 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:22.052655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:22.065071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f0f057c6-e060-48d5-a0b6-4f403daf423a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1219 microversion: 2.1 time: 0.168533 Jun 02 13:20:22.067175 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 5/14] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:21 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:22.506054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-95423934-91bc-42ae-ad4d-c1db4100a08d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a823461f0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:22.551208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-95423934-91bc-42ae-ad4d-c1db4100a08d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.048862 Jun 02 13:20:22.555899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 10/15] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:22 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:23.084091 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:23.085370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:23.094701 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:23.097781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:23.100529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:23.102883 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:23.298860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:23.309162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4f862813-1b6e-4cc9-ba76-191c295aaaf0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1219 microversion: 2.1 time: 0.230335 Jun 02 13:20:23.309873 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 6/16] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:23 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:23.570125 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-558904e5-abcf-43cb-b800-be2ac82ae308 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fd3a0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:23.641462 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-558904e5-abcf-43cb-b800-be2ac82ae308 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.082516 Jun 02 13:20:23.642364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 11/17] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:23 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:24.327085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:24.327862 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:24.347624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:24.348422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:24.349118 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:24.349656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:24.553612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:24.563562 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-31369ec5-2e2b-46ca-848f-758b72e2c988 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1219 microversion: 2.1 time: 0.240756 Jun 02 13:20:24.566556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 7/18] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:24 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:24.655206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-43d2eddc-677e-4d65-b3e9-de5080075dc1 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822fdb80>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:24.744150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-43d2eddc-677e-4d65-b3e9-de5080075dc1 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.092504 Jun 02 13:20:24.747924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 12/19] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:24 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:25.586447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:25.587085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:25.625503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:25.626257 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:25.627285 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:25.627970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:25.759352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-de214c7e-da97-4ec1-b942-68c2817f8c9d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a8239f700>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:25.810161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:25.827124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-18109cd1-13ca-45fa-8b6c-c4031dc42c24 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1275 microversion: 2.1 time: 0.245723 Jun 02 13:20:25.842511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-de214c7e-da97-4ec1-b942-68c2817f8c9d tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 288 microversion: 2.1 time: 0.088522 Jun 02 13:20:25.843612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 13/20] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:25 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:25.854155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-032bae1d-2a5a-4870-b08f-4869b2515ca4 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a822f6d30>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:25.860191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 8/21] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:25 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:26.152459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-032bae1d-2a5a-4870-b08f-4869b2515ca4 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 202 len: 0 microversion: 2.1 time: 0.301999 Jun 02 13:20:26.154134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 14/22] 10.222.0.46 () {58 vars in 1253 bytes} [Thu Jun 2 13:20:25 2022] DELETE /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:20:26.164838 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bfcb190f-1daf-447c-9ffe-13005888e991 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a81241ee0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:26.256005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bfcb190f-1daf-447c-9ffe-13005888e991 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 200 len: 287 microversion: 2.1 time: 0.097165 Jun 02 13:20:26.257554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 9/23] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:26 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:26.856760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:26.857926 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:26.885067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:26.886570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:26.889462 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:26.890325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:27.209133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:27.246010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-af60c69f-29b9-4614-b2be-6f65e250d9a0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1273 microversion: 2.1 time: 0.402692 Jun 02 13:20:27.261035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 15/24] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:26 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:27.265677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:27.274112 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c9217595-cbbe-467d-9de3-e92d9f135471 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a81190c10>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:27.647646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-c9217595-cbbe-467d-9de3-e92d9f135471 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] HTTP exception thrown: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c9217595-cbbe-467d-9de3-e92d9f135471 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Request method failure captured: Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 HTTP/1.1 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkMs0amGBKca7WF76Gnsgr_vrBSPggir-9V88WIR1JMNPYsagifBN68SEVRBPKSQph9LsKItABUeMFH9VHvGDJ1nhJ8Pxnv8NsO29VD6Moxq0cBu35Dj9-12CR1mXdRd2S1Os-MI8JfeNxhMNBhEWZ3ofzQptq_5auLBuiQQLkSwIU Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:27.656825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6cf137da41884a70b893f5214753fa82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6cf137da41884a70b893f5214753fa82"}]}] Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 343b4d48405447f69393092d7b29fb82 Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'a69499ee-7e89-481d-b68e-5c5c00d8f548'} Jun 02 13:20:27.658088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. (HTTP 404) (Request-ID: req-2fa68165-1cc2-4198-be0f-3099fecc4479) Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.658804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:27.659730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 13:20:27.660821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. Jun 02 13:20:27.663622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:27.666632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c9217595-cbbe-467d-9de3-e92d9f135471 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Returning 404 to user: Snapshot a69499ee-7e89-481d-b68e-5c5c00d8f548 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:27.668953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c9217595-cbbe-467d-9de3-e92d9f135471 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548" status: 404 len: 111 microversion: 2.1 time: 0.404042 Jun 02 13:20:27.670367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 10/25] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:20:27 2022] GET /compute/v2.1/os-snapshots/a69499ee-7e89-481d-b68e-5c5c00d8f548 => generated 111 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:20:27.691622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0020ffb2-e96b-4e1f-aee0-6959ca2dfae4 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a82283af0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:27.737237 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:28.088373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0020ffb2-e96b-4e1f-aee0-6959ca2dfae4 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 202 len: 0 microversion: 2.1 time: 0.413714 Jun 02 13:20:28.090138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 16/26] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:20:27 2022] DELETE /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:20:28.102313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-abbbfa99-50ec-42b6-9af2-2840b23788f1 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a81152e50>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:28.236404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-abbbfa99-50ec-42b6-9af2-2840b23788f1 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.141107 Jun 02 13:20:28.237283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 11/27] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:28 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:28.269511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:28.270177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:28.298186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:28.308107 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:28.309222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:28.311449 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:28.586614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:28.595562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-323f25d1-81b9-42d0-9c55-8613d04c497a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1273 microversion: 2.1 time: 0.330551 Jun 02 13:20:28.610298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 17/28] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:28 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:29.061750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b83c83ed-eef1-42e5-bedd-1749005e1aa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: .version_select at 0x7f5a811de670>, body: {"keypair": {"name": "tempest-keypair-525965325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5+EHZHrAJRUbIybGeE+1atqB9fq3Ozd7QxQCKWebeWD9EMBWnPysBFZfWB+zi50CyajahsGX6p/3OrOcIvE8zV7lcMd2CGspguEq8FyMT1WJRBGmGswKPUh8g3EWMvxQ=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:29.209050 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-b83c83ed-eef1-42e5-bedd-1749005e1aa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:29.209050 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-b83c83ed-eef1-42e5-bedd-1749005e1aa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for user a99a2ba62f3948e99f6e78cabade3685 and project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:29.251390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b1304eeb-9b37-43d7-8c0a-0e2973214d1c tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a82283c10>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:29.328126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b1304eeb-9b37-43d7-8c0a-0e2973214d1c tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.081567 Jun 02 13:20:29.329122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 18/29] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:29 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:20:29.433093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b83c83ed-eef1-42e5-bedd-1749005e1aa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.780120 Jun 02 13:20:29.436048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 12/30] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:20:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:29.618826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:29.619770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:29.632373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:29.634715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:29.635820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:29.640049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:30.097622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:30.107395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4063b1b1-bbaa-46d5-ab82-2da8f1f541a7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.493497 Jun 02 13:20:30.112577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 19/31] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:29 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:30.289793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1672719198", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:30.343000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5db45e85-3bc8-4a33-a150-0d1466e4c5ed tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a8239f790>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:30.405068 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] validate_networks() for [('deba372e-ce1f-430d-9406-fbc12c395831', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:20:30.459787 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5db45e85-3bc8-4a33-a150-0d1466e4c5ed tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.121412 Jun 02 13:20:30.460497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 20/32] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:30 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:20:31.161295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cc4da4ca-1173-4baf-8801-abcc5904b4c5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: .version_select at 0x7f5a82236b80>, body: {"keypair": {"name": "tempest-keypair-1623527987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWkKYwCjLbKt3gsd6WloIFAKtSJp4vtIODV4NoxmcDkSkgi9wjTuA0MTAXvWG5aymQLfl4gCQKuV3fKSxUWt6Hb0xxMoLeb5pHTgl3m0bG1Js6yxePOgR2kBBdM/VF7bA=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:31.221266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:20:31.221687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:20:31.222232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:20:31.222627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:20:31.223034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:20:31.254802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:31.256771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:31.257886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:31.259927 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:31.262517 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-cc4da4ca-1173-4baf-8801-abcc5904b4c5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for project afa347af05aa4e40b5960fd0aea87c54. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:31.274758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-cc4da4ca-1173-4baf-8801-abcc5904b4c5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for user 37a7776277ca42eba4476242438fbf6d and project afa347af05aa4e40b5960fd0aea87c54. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:31.308147 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:31.334916 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for user 5c3f539d6d374fd8b3eaa9e3e22e5cb1 and project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:31.364003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:20:31.370987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:20:31.457883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cc4da4ca-1173-4baf-8801-abcc5904b4c5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.589439 Jun 02 13:20:31.457883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 21/33] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jun 2 13:20:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 591 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 13:20:31.465733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:31.467474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:31.481949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:31.482386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:31.487661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:31.491739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:31.521168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6e11a259-e7a6-4b19-96fc-9f7b8edcaa0b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.411268 Jun 02 13:20:31.537893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 13/34] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:20:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:20:31.559805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-921e4ab8-7276-441d-b28d-171d4640162c tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a810c6dc0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:31.694955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-921e4ab8-7276-441d-b28d-171d4640162c tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.151745 Jun 02 13:20:31.695648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 14/35] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:31 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:31.701411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aecdcd78-fdc8-40e3-bb97-fd6026594dff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:31.703470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aecdcd78-fdc8-40e3-bb97-fd6026594dff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:32.092908 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aecdcd78-fdc8-40e3-bb97-fd6026594dff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:32.102223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aecdcd78-fdc8-40e3-bb97-fd6026594dff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1222 microversion: 2.1 time: 0.403268 Jun 02 13:20:32.102875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 15/36] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:31 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:32.214681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:32.228874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-78b4c18e-f964-4066-97b5-513c6a54ef69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.775461 Jun 02 13:20:32.233446 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 22/37] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:31 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:32.473551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1165314974", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:32.587609 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] validate_networks() for [('deba372e-ce1f-430d-9406-fbc12c395831', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:20:32.708838 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4be74832-8102-4667-9c7c-4113b3b4aa94 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a819cb160>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:32.825175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4be74832-8102-4667-9c7c-4113b3b4aa94 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.110259 Jun 02 13:20:32.825175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 23/38] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:32 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:33.249509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:33.250390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:33.263647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:33.271063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:33.272755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:33.273212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:33.893251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:33.907538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cbc65e34-1167-49bb-ab3e-61f807f40ef8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.662195 Jun 02 13:20:33.908297 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 24/39] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:33 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:33.934987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e46d7a8c-2205-4b0e-aa4d-e38ca8af0613 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a819cba60>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:34.076277 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e46d7a8c-2205-4b0e-aa4d-e38ca8af0613 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.166855 Jun 02 13:20:34.077528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 25/40] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:33 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:34.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:20:34.923000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:20:34.926353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:20:34.928682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:20:34.929370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:20:34.930534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:34.931508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:34.943332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:34.952144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:34.955818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:34.956602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:34.957610 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:34.958179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:34.958938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:34.974727 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:35.026451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:35.036629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for user 5c3f539d6d374fd8b3eaa9e3e22e5cb1 and project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:35.073513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:20:35.079441 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:20:35.253584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7536040e-6870-412a-9442-5a0e9c990ba2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.781426 Jun 02 13:20:35.254650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 16/41] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:20:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:20:35.274871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-82191809-b664-4789-a67b-d27e47b4376a tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a810ce820>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:35.387708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-82191809-b664-4789-a67b-d27e47b4376a tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.131903 Jun 02 13:20:35.393106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 17/42] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:35 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:35.399287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-499380c3-0558-4ec6-8062-445ab0f80745 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:35.399951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-499380c3-0558-4ec6-8062-445ab0f80745 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:35.600688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-499380c3-0558-4ec6-8062-445ab0f80745 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:35.610615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-499380c3-0558-4ec6-8062-445ab0f80745 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1222 microversion: 2.1 time: 0.218658 Jun 02 13:20:35.611409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 18/43] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:35 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:35.815456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:35.824909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-154e6d65-bcb4-43f4-b4f1-96484500dd3e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.903674 Jun 02 13:20:35.826002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 26/44] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:34 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:36.403168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f3b9adf5-2e80-4b5b-a913-a88a9c50922a tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a810ced30>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:36.478316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-508032684", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "695fac8a-ad9b-4f70-8314-c863cffa2edb"}], "security_groups": [{"name": "tempest-securitygroup--2115070131"}], "key_name": "tempest-keypair-525965325", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:36.479738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f3b9adf5-2e80-4b5b-a913-a88a9c50922a tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 200 len: 344 microversion: 2.1 time: 0.082140 Jun 02 13:20:36.485109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 19/45] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:36 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:36.629659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ccb03718-ba88-48ac-a9a5-c0bf1c10ef65 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:36.630345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ccb03718-ba88-48ac-a9a5-c0bf1c10ef65 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:36.719387 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] validate_networks() for [('695fac8a-ad9b-4f70-8314-c863cffa2edb', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:20:36.831792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ccb03718-ba88-48ac-a9a5-c0bf1c10ef65 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:36.846153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ccb03718-ba88-48ac-a9a5-c0bf1c10ef65 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1222 microversion: 2.1 time: 0.221226 Jun 02 13:20:36.873961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 20/46] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:36 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1222 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:36.898964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:36.899956 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:36.909660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:36.910443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:36.911816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:36.912540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:37.975955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:38.015909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5f2df6ac-67a4-4bf8-891e-04ebf5f75107 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 1.122651 Jun 02 13:20:38.015909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 21/47] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:36 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:38.281578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-4f28cd91-49ab-4208-920a-084e5c286b6e req-0a24c958-2502-49e2-89f0-c61adb35c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f653ea90-3377-4409-aefc-bd9db30f1841", "tag": "5294a6c8-3267-40ee-b768-877080b87580"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:38.338601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-4f28cd91-49ab-4208-920a-084e5c286b6e req-0a24c958-2502-49e2-89f0-c61adb35c4ff service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.362893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-4f28cd91-49ab-4208-920a-084e5c286b6e req-0a24c958-2502-49e2-89f0-c61adb35c4ff service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.493441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:20:38.493880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:20:38.494364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:20:38.494826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:20:38.495428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:20:38.508461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-4f28cd91-49ab-4208-920a-084e5c286b6e req-0a24c958-2502-49e2-89f0-c61adb35c4ff service nova] Creating event network-changed:5294a6c8-3267-40ee-b768-877080b87580 for instance f653ea90-3377-4409-aefc-bd9db30f1841 on hv-cinder-79760 Jun 02 13:20:38.511658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-4f28cd91-49ab-4208-920a-084e5c286b6e req-0a24c958-2502-49e2-89f0-c61adb35c4ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=118131) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:20:38.517928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.517928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.517928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.517928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.546196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.compute.rpcapi [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:20:38.547787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] Releasing lock "compute-rpcapi-router" {{(pid=118131) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:20:38.610141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-39385112-9a9e-4856-b9f7-3113c4289d39 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586295 Jun 02 13:20:38.610827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 22/48] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:38.619284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ed886215-52eb-43f1-8542-3ad4b412520f tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a810ce700>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:38.641169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.642022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.654565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.659364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.699920 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-ed886215-52eb-43f1-8542-3ad4b412520f tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] HTTP exception thrown: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ed886215-52eb-43f1-8542-3ad4b412520f tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Request method failure captured: Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 HTTP/1.1 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkMs0amGBKca7WF76Gnsgr_vrBSPggir-9V88WIR1JMNPYsagifBN68SEVRBPKSQph9LsKItABUeMFH9VHvGDJ1nhJ8Pxnv8NsO29VD6Moxq0cBu35Dj9-12CR1mXdRd2S1Os-MI8JfeNxhMNBhEWZ3ofzQptq_5auLBuiQQLkSwIU Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:38.702461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6cf137da41884a70b893f5214753fa82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6cf137da41884a70b893f5214753fa82"}]}] Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 343b4d48405447f69393092d7b29fb82 Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '95bf6892-e78a-4f4d-b1f7-eab2094f6021'} Jun 02 13:20:38.703797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. (HTTP 404) (Request-ID: req-ad03df74-cc49-44cb-923c-88af3493e19b) Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:38.704767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:38.705944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:20:38.707071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:38.708269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:38.709467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ed886215-52eb-43f1-8542-3ad4b412520f tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Returning 404 to user: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:38.711733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ed886215-52eb-43f1-8542-3ad4b412520f tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 404 len: 109 microversion: 2.1 time: 0.098831 Jun 02 13:20:38.712915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 23/49] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:38 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:38.727284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:38.743621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:38.772583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.774190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.775505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:38.776302 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:38.837171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:38.850992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for user a99a2ba62f3948e99f6e78cabade3685 and project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:38.941033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:20:38.954285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:20:39.031974 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:39.052582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7e9f14e9-1833-4699-9bc2-c89f3558d1e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1218 microversion: 2.1 time: 0.337752 Jun 02 13:20:39.064466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 24/50] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:38 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:39.077714 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6383e0af-6584-465f-899b-2da39ef4639e tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a8119f430>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:39.117725 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-6383e0af-6584-465f-899b-2da39ef4639e tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] HTTP exception thrown: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6383e0af-6584-465f-899b-2da39ef4639e tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Request method failure captured: Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 HTTP/1.1 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkMs0amGBKca7WF76Gnsgr_vrBSPggir-9V88WIR1JMNPYsagifBN68SEVRBPKSQph9LsKItABUeMFH9VHvGDJ1nhJ8Pxnv8NsO29VD6Moxq0cBu35Dj9-12CR1mXdRd2S1Os-MI8JfeNxhMNBhEWZ3ofzQptq_5auLBuiQQLkSwIU Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:39.120800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6cf137da41884a70b893f5214753fa82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6cf137da41884a70b893f5214753fa82"}]}] Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 343b4d48405447f69393092d7b29fb82 Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '95bf6892-e78a-4f4d-b1f7-eab2094f6021'} Jun 02 13:20:39.122096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. (HTTP 404) (Request-ID: req-372fdacf-5a3b-4c4c-9d6c-7d53aca3711a) Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.123161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:39.124376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:20:39.125492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.126603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.127484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6383e0af-6584-465f-899b-2da39ef4639e tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Returning 404 to user: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:39.128564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6383e0af-6584-465f-899b-2da39ef4639e tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 404 len: 109 microversion: 2.1 time: 0.062565 Jun 02 13:20:39.131544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 25/51] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:20:39 2022] DELETE /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:39.143135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:39.143135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:39.148437 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:39.149231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:39.150196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:39.150800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:39.292066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-74db5c2d-fa41-4f4a-a96c-8559ba5861eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.815874 Jun 02 13:20:39.296095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:20:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:20:39.316324 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ef5a5bf7-a8b9-4183-8c19-5f8a4d595cf6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Calling method '.version_select at 0x7f5a8197fee0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:39.633533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-ef5a5bf7-a8b9-4183-8c19-5f8a4d595cf6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] HTTP exception thrown: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ef5a5bf7-a8b9-4183-8c19-5f8a4d595cf6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Request method failure captured: Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 HTTP/1.1 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkMs0amGBKca7WF76Gnsgr_vrBSPggir-9V88WIR1JMNPYsagifBN68SEVRBPKSQph9LsKItABUeMFH9VHvGDJ1nhJ8Pxnv8NsO29VD6Moxq0cBu35Dj9-12CR1mXdRd2S1Os-MI8JfeNxhMNBhEWZ3ofzQptq_5auLBuiQQLkSwIU Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:20:39.639027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6cf137da41884a70b893f5214753fa82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6cf137da41884a70b893f5214753fa82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6cf137da41884a70b893f5214753fa82"}]}] Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 6cf137da41884a70b893f5214753fa82 Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-649415320 Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 343b4d48405447f69393092d7b29fb82 Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-649415320-project Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '95bf6892-e78a-4f4d-b1f7-eab2094f6021'} Jun 02 13:20:39.640188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. (HTTP 404) (Request-ID: req-440f763c-9b0f-4918-aeb7-3b2c6ef8936d) Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.640826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:39.642369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:20:39.643250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ef5a5bf7-a8b9-4183-8c19-5f8a4d595cf6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] Returning 404 to user: Volume 95bf6892-e78a-4f4d-b1f7-eab2094f6021 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ef5a5bf7-a8b9-4183-8c19-5f8a4d595cf6 tempest-VolumesSnapshotsTestJSON-649415320 tempest-VolumesSnapshotsTestJSON-649415320-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021" status: 404 len: 109 microversion: 2.1 time: 0.341491 Jun 02 13:20:39.645254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 28/53] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:39 2022] GET /compute/v2.1/os-volumes/95bf6892-e78a-4f4d-b1f7-eab2094f6021 => generated 109 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:39.653611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-febee2f3-1abb-4315-95f3-e4edd4ec1b18 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:39.654226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-febee2f3-1abb-4315-95f3-e4edd4ec1b18 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:39.817916 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:39.840343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ebcaab78-09b4-45da-892e-58a2e0d89bfa tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.707485 Jun 02 13:20:39.841433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 26/54] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:39 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:39.886410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-febee2f3-1abb-4315-95f3-e4edd4ec1b18 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:39.894503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-febee2f3-1abb-4315-95f3-e4edd4ec1b18 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1236 microversion: 2.1 time: 0.252301 Jun 02 13:20:39.908821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 29/55] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:39 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1236 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:40.071766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:40.072581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:40.081885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:40.082335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:40.085015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:40.087028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:40.149924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1725034540", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0740c50-521e-4167-b47e-482ca4a8ede8"}], "security_groups": [{"name": "tempest-securitygroup--1952231315"}], "key_name": "tempest-keypair-1623527987", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:40.272221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:40.286709 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-684cbc5d-049f-4475-a3f5-b4a2b916ab14 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1274 microversion: 2.1 time: 0.219594 Jun 02 13:20:40.297783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 27/56] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:40 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:40.483359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] validate_networks() for [('b0740c50-521e-4167-b47e-482ca4a8ede8', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:20:40.856810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:40.857474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:40.869329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:40.869789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:40.870673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:40.871182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:41.289999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:41.337175 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7ac279e9-5bba-47bb-a473-e48266450d5e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.480095 Jun 02 13:20:41.339943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 28/57] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:40 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:41.372383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7862dc1a-9418-4915-8523-8c126dcda4cb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:41.373497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7862dc1a-9418-4915-8523-8c126dcda4cb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:41.378358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:41.556425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7862dc1a-9418-4915-8523-8c126dcda4cb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:41.566819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7862dc1a-9418-4915-8523-8c126dcda4cb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1236 microversion: 2.1 time: 0.224030 Jun 02 13:20:41.569777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 29/58] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:41 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1236 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:41.593568 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:41.595495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:41.617970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:41.619515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:41.619515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:41.619515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:41.846680 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:41.860559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5acd20fb-51f2-42b9-8db9-66473d15d4e6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1280 microversion: 2.1 time: 0.289313 Jun 02 13:20:41.886065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:41 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:42.356565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:42.357974 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:42.370029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.370735 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:42.372747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.375537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:42.574946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:20:42.575409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:20:42.584269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:20:42.585207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:20:42.586804 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:20:42.609959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.610989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:42.612083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.612614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:42.638874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for project afa347af05aa4e40b5960fd0aea87c54. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:20:42.643677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for user 37a7776277ca42eba4476242438fbf6d and project afa347af05aa4e40b5960fd0aea87c54. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:20:42.679887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:20:42.682267 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:20:42.928268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:42.936206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cffa0629-1ada-4e49-b779-1269caca6fbb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.583372 Jun 02 13:20:42.949459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 31/60] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:42 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:42.957496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:42.958114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:42.972699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.974893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:42.974893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:42.974893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:43.060116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6f8093e2-b2cb-4ac9-93df-76745b54f740 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.929484 Jun 02 13:20:43.064725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 30/61] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Jun 2 13:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 02 13:20:43.071686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:43.085963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6e72ee83-f5ee-4cbc-9433-65b92f6d283b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1288 microversion: 2.1 time: 0.135241 Jun 02 13:20:43.093127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 32/62] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:42 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:43.101023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:43.101673 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:43.105335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:43.105947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:43.120574 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:43.131774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:43.136149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:43.137278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:43.257941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:43.267624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:43.270427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:43.272897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-88159cae-3348-439d-9b0a-2de80c0374e7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1282 microversion: 2.20 time: 0.177797 Jun 02 13:20:43.284589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 33/63] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:43 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:43.399097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:43.406783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f4190567-3d31-4c3f-aa53-752e5cfa868c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1280 microversion: 2.1 time: 0.340118 Jun 02 13:20:43.407355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 31/64] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:43 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:43.969693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:43.969693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:43.969693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:43.969693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:43.972535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:43.973272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:44.111456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:44.112395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:44.115161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:44.140889 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:44.142129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:44.148808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:44.149926 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:44.399232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.401728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=93 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:44.408012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4aea0bf4-ae91-462b-a492-0250f81f5c69 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.456970 Jun 02 13:20:44.422387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 34/65] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:43 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:44.422620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.422713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:44.422713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:44.429347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-277dca80-0edd-4784-91e7-38f1571f2276 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1296 microversion: 2.1 time: 0.322439 Jun 02 13:20:44.433997 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 32/66] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:44 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1296 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:44.449743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:44.455957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:44.473450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:44.475454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:44.476852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:44.480621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:44.491587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.498016 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=35 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:44.501480 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.503572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.505077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-67e62e35-df5f-4d3d-8d4e-dbbeb467b64a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1282 microversion: 2.20 time: 0.095552 Jun 02 13:20:44.505912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 35/67] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:44 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:44.620059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:44.630606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34bbf172-aaff-4673-8fbe-7d44aa96726a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1280 microversion: 2.1 time: 0.192897 Jun 02 13:20:44.632137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 33/68] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:44 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:45.438832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:45.439473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:45.466403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:45.467083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.467165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:45.467246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.467246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.467246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.477505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.479790 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.480771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.484481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.592994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.601554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ec251ee-230b-440d-86ab-1db2b893861b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1296 microversion: 2.1 time: 0.151323 Jun 02 13:20:45.612061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:45 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:45.622025 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:45.622638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:45.736557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.745595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.751463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.756036 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-01895e26-c627-452c-b431-5ceaaca24056 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1282 microversion: 2.20 time: 0.145675 Jun 02 13:20:45.760470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:45 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:45.766963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:45.768024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:45.778203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.778925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.780250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:45.780848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:45.849733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.858284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-97d9a519-2cdf-4b36-8fc9-6fd6107a3262 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.423090 Jun 02 13:20:45.859740 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 36/71] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:45 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:45.972573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:45.980287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-717a476e-ab61-4bcc-bcf0-8468adf599aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.218276 Jun 02 13:20:45.981063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 36/72] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:45 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:46.625575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:46.627138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:46.635058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:46.643021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:46.643021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:46.643021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:46.775563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:46.776248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:46.783333 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:46.784493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:46.785728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:46.786672 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.092953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.107068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.109854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.111188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f5392f7b-d61b-4251-b995-781cac0d5778 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1286 microversion: 2.20 time: 0.340493 Jun 02 13:20:47.122848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:46 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1286 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:20:47.124291 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.133062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:47.135938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:47.136262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9710c7c5-dfb4-4cb5-a067-4581af5f9330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.513256 Jun 02 13:20:47.138371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 37/74] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:46 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:47.148686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.151380 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:47.152103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.152222 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:47.152824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.153273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.164546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.165039 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.168384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.168838 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.427261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.441170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2206c205-398c-49f3-b55c-a758c40d96d7 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.315458 Jun 02 13:20:47.441170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 38/75] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:47 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:47.513303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:47.542533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-63e3b21a-2e08-40f1-ad06-b261512718f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.394740 Jun 02 13:20:47.548447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 38/76] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:47 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:47.594550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f68ae1a-e680-4d06-a5a6-ede7e453ea58 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Action: 'create', calling method: .version_select at 0x7f5a8088e550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-355546342", "metadata": {"Type": "work"}}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f68ae1a-e680-4d06-a5a6-ede7e453ea58 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 121 Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:20:47.619966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-355546342", "metadata": {"Type": "work"}}} Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: Jun 02 13:20:47.621443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-355546342', 'metadata': {'Type': 'work'}}}} Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.622362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:20:47.623476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:20:47.624630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:20:47.624630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.624630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f68ae1a-e680-4d06-a5a6-ede7e453ea58 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.624630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f68ae1a-e680-4d06-a5a6-ede7e453ea58 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183932 Jun 02 13:20:47.624630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 39/77] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 2 13:20:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:20:47.634430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-022eaf02-f7fb-453c-993f-482231479453 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Action: 'create', calling method: .version_select at 0x7f5a81074160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1392836007", "metadata": {"Type": "work"}}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-022eaf02-f7fb-453c-993f-482231479453 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 120 Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:47.638158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1392836007", "metadata": {"Type": "work"}}} Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:47.639796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1392836007', 'metadata': {'Type': 'work'}}}} Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi '0' Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.640492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:20:47.641602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:20:47.642498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:20:47.642498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.642498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-022eaf02-f7fb-453c-993f-482231479453 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.642498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-022eaf02-f7fb-453c-993f-482231479453 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009443 Jun 02 13:20:47.642498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 39/78] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 2 13:20:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:20:47.653040 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0183581-4036-406d-88e4-d0806ebecdbf tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Action: 'create', calling method: .version_select at 0x7f5a8087e940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1129819296", "metadata": {"Type": "work"}}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0183581-4036-406d-88e4-d0806ebecdbf tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 119 Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:20:47.656195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1129819296", "metadata": {"Type": "work"}}} Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: Jun 02 13:20:47.657241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1129819296', 'metadata': {'Type': 'work'}}}} Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi '' Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.657953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:20:47.658977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:20:47.659913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:20:47.659913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.659913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0183581-4036-406d-88e4-d0806ebecdbf tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.659913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e0183581-4036-406d-88e4-d0806ebecdbf tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010468 Jun 02 13:20:47.670320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6b4f75d8-487c-4250-a5d8-9358d0efc1aa tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Calling method '.version_select at 0x7f5a8109ddc0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:47.676599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 40/79] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 2 13:20:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:20:47.717899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-6b4f75d8-487c-4250-a5d8-9358d0efc1aa tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] HTTP exception thrown: Volume tempest-invalid-423356092 could not be found. Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6b4f75d8-487c-4250-a5d8-9358d0efc1aa tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-423356092 HTTP/1.1 Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:47.720268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Volume tempest-invalid-423356092 could not be found. Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'tempest-invalid-423356092'} Jun 02 13:20:47.721443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-423356092 could not be found. (HTTP 404) (Request-ID: req-5c292140-49c6-49ab-b104-f524ee38ee54) Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.722094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:47.723135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-423356092 could not be found. Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:47.728160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-423356092 could not be found. Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-423356092 could not be found. Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6b4f75d8-487c-4250-a5d8-9358d0efc1aa tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 404 to user: Volume tempest-invalid-423356092 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6b4f75d8-487c-4250-a5d8-9358d0efc1aa tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-423356092" status: 404 len: 98 microversion: 2.1 time: 0.057191 Jun 02 13:20:47.730766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 40/80] 10.222.0.46 () {58 vars in 1214 bytes} [Thu Jun 2 13:20:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-423356092 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 02 13:20:47.738294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25fb1527-588a-4aa3-b14d-e21099774c72 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006142 Jun 02 13:20:47.738804 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Jun 2 13:20:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 13:20:47.750544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-883f58ae-a04e-4d2a-b8e3-d29fd3e2fb5e tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003858 Jun 02 13:20:47.751189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 41/82] 10.222.0.46 () {58 vars in 1136 bytes} [Thu Jun 2 13:20:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 13:20:47.761548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea242b4c-df95-49b5-8d54-6ef90bc44aa1 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Calling method '.version_select at 0x7f5a8088e040>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:47.816803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-ea242b4c-df95-49b5-8d54-6ef90bc44aa1 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] HTTP exception thrown: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea242b4c-df95-49b5-8d54-6ef90bc44aa1 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/os-volumes/24dfee8a-6881-4042-899b-675fb5dcb996 HTTP/1.1 Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:20:47.819814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '24dfee8a-6881-4042-899b-675fb5dcb996'} Jun 02 13:20:47.821109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. (HTTP 404) (Request-ID: req-4b46fe79-af2f-4077-89ad-0b9d002cb40c) Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.821899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:20:47.822906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:20:47.823841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. Jun 02 13:20:47.827166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.830429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea242b4c-df95-49b5-8d54-6ef90bc44aa1 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 404 to user: Volume 24dfee8a-6881-4042-899b-675fb5dcb996 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.832244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ea242b4c-df95-49b5-8d54-6ef90bc44aa1 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/24dfee8a-6881-4042-899b-675fb5dcb996" status: 404 len: 109 microversion: 2.1 time: 0.074091 Jun 02 13:20:47.844602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88b14fdc-9bb0-41bb-95aa-3a1987c4cbd0 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Calling method '.version_select at 0x7f5a810744c0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:47.848289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 42/83] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:20:47 2022] DELETE /compute/v2.1/os-volumes/24dfee8a-6881-4042-899b-675fb5dcb996 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:47.897852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-f4ceb29c-7859-4cba-affa-ace7c8d85f5d req-359225bd-fc36-4580-b343-d58e945df2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e59264d-5544-48cd-a508-5c7b119cfeae", "tag": "1b1f8072-eaa6-4034-99a8-a965c894139b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:47.929795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-88b14fdc-9bb0-41bb-95aa-3a1987c4cbd0 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] HTTP exception thrown: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88b14fdc-9bb0-41bb-95aa-3a1987c4cbd0 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Request method failure captured: Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/0589905f-39ed-45d8-bbf8-2777a2cef9dc HTTP/1.1 Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkvsKnj8fgUTB8pioehRfCwkI-YY9rnVKshFkkpSdSkuVHeJ_NerA_wM-5EjkBBD8L5ThCOvpNmg8fhUhF613mYdpCbHBetzToINs0Vt7k-esT7QTW5pCFnM3Kkh-ai8OoU4wQYjW2r4x_DUK991nK2cBXWrf7t1DtblTiLOC1McAs Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:20:47.932333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56e7034bde0341e799d60bbf56ba03ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56e7034bde0341e799d60bbf56ba03ce"}]}] Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 56e7034bde0341e799d60bbf56ba03ce Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1099670857 Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: fddfb4ff2afa4a56a4232d92d5a4e9fa Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1099670857-project Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '0589905f-39ed-45d8-bbf8-2777a2cef9dc'} Jun 02 13:20:47.933439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. (HTTP 404) (Request-ID: req-af6c4684-9b5b-4868-a9ea-545e134ac982) Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.934116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:20:47.935065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:20:47.935989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88b14fdc-9bb0-41bb-95aa-3a1987c4cbd0 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] Returning 404 to user: Volume 0589905f-39ed-45d8-bbf8-2777a2cef9dc could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:20:47.936896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-88b14fdc-9bb0-41bb-95aa-3a1987c4cbd0 tempest-VolumesNegativeTest-1099670857 tempest-VolumesNegativeTest-1099670857-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0589905f-39ed-45d8-bbf8-2777a2cef9dc" status: 404 len: 109 microversion: 2.1 time: 0.093210 Jun 02 13:20:47.944593 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 42/84] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:20:47 2022] GET /compute/v2.1/os-volumes/0589905f-39ed-45d8-bbf8-2777a2cef9dc => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:47.949256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f4ceb29c-7859-4cba-affa-ace7c8d85f5d req-359225bd-fc36-4580-b343-d58e945df2bf service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.949918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f4ceb29c-7859-4cba-affa-ace7c8d85f5d req-359225bd-fc36-4580-b343-d58e945df2bf service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.976602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-f4ceb29c-7859-4cba-affa-ace7c8d85f5d req-359225bd-fc36-4580-b343-d58e945df2bf service nova] Creating event network-changed:1b1f8072-eaa6-4034-99a8-a965c894139b for instance 1e59264d-5544-48cd-a508-5c7b119cfeae on hv-cinder-79760 Jun 02 13:20:47.977388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f4ceb29c-7859-4cba-affa-ace7c8d85f5d req-359225bd-fc36-4580-b343-d58e945df2bf service nova] Acquired lock "compute-rpcapi-router" {{(pid=118132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:20:47.978897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.979518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.980834 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:47.981449 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:47.994373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.compute.rpcapi [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:20:48.003165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:20:48.033684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2b551d61-b634-4454-9d49-4e876c18c1c5 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143472 Jun 02 13:20:48.035585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 43/85] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:48.132374 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:48.133334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:48.145726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.146798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.151107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.160564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:48.162321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:48.165283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.196320 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.205081 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.206209 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.207256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.324024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.336711 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.339918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.341321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d9f16a61-1862-4e20-ab23-a8a5b41c07cd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1278 microversion: 2.20 time: 0.215129 Jun 02 13:20:48.342442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 43/86] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:48 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:48.454290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:48.455109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:48.464990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.465579 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.466595 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.467104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.533859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:48.607640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.617616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-345a79ed-a8f9-44a6-91e8-ced15a9d7d48 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.466191 Jun 02 13:20:48.621288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 44/87] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:48 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:48.626928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:48.628105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:48.635688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.636157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.636927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:48.637393 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:48.704207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.714300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1d493611-cb91-4fa3-b697-22d0a3c1fa6e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.263908 Jun 02 13:20:48.725655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 44/88] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:48 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:48.908972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:48.931157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-46285960-c514-4389-b2cd-95c5e7b512af tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.307872 Jun 02 13:20:48.932475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 45/89] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:48 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:49.094589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-197a65a9-7b63-4863-9269-915c8457f6c1 req-bb3e5a01-146e-4c26-b918-da7f44252086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924c7837-38cd-4d99-bc12-6d1631a6fd43", "tag": "a385ba1f-8741-43e7-8512-5ec1a8ccf941"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:49.106481 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-197a65a9-7b63-4863-9269-915c8457f6c1 req-bb3e5a01-146e-4c26-b918-da7f44252086 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.108451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-197a65a9-7b63-4863-9269-915c8457f6c1 req-bb3e5a01-146e-4c26-b918-da7f44252086 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.122129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-197a65a9-7b63-4863-9269-915c8457f6c1 req-bb3e5a01-146e-4c26-b918-da7f44252086 service nova] Creating event network-changed:a385ba1f-8741-43e7-8512-5ec1a8ccf941 for instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 on hv-cinder-79760 Jun 02 13:20:49.131462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-197a65a9-7b63-4863-9269-915c8457f6c1 req-bb3e5a01-146e-4c26-b918-da7f44252086 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207405 Jun 02 13:20:49.131462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 45/90] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:49.360268 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:49.361507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:49.369970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.371521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.372541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.373163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.397313 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:49.454146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:49.462226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:49.464030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:49.465124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dadaace0-83c8-49ee-aae3-f46b5553b950 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1278 microversion: 2.20 time: 0.108894 Jun 02 13:20:49.465690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 46/91] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:49 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:20:49.652379 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:49.653136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:49.663227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.664074 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.665264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.665850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.732940 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:49.734018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:49.740947 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.741485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.742371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.742880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.949024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:49.963040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eb47de3d-ff95-4c67-bb29-c4fa34721487 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.332539 Jun 02 13:20:49.965014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 46/92] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:49 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:49.971982 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:49.972840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:49.984288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.985628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:49.987358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:49.988487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:50.186742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:50.199064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-201c5936-2c31-4ccf-a105-2d4a3730e63a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.232589 Jun 02 13:20:50.205635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 47/93] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:49 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:50.361244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:50.371244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ccf49eb1-51c0-41c4-bfba-a2060f66ad5f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.642183 Jun 02 13:20:50.383919 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 47/94] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:49 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:50.484043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:50.484901 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:50.492353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:50.493009 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:50.493839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:50.494326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:50.556394 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:50.564681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:50.566185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:50.567293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4dfa9b12-7225-4c02-84c0-61e8fe45f9f9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1334 microversion: 2.20 time: 0.087539 Jun 02 13:20:50.567852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 48/95] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:50 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:50.981035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:50.983313 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:50.990453 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:50.990994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:50.992189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:50.992858 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.138523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.146770 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-faa02936-d1b6-4fdd-ad4f-1681df1801a1 req-691cd97f-f898-4c18-ac0e-7d0b53e9a4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d47700d-bd87-46b1-baae-0c9fb526d72b", "tag": "9b84ac82-613a-4b00-bcf2-9aeb7ab3b255"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:51.162990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-faa02936-d1b6-4fdd-ad4f-1681df1801a1 req-691cd97f-f898-4c18-ac0e-7d0b53e9a4ac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.163645 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-faa02936-d1b6-4fdd-ad4f-1681df1801a1 req-691cd97f-f898-4c18-ac0e-7d0b53e9a4ac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.175215 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f6fe5434-1fdb-45f6-b224-e921f63ae7b1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.198192 Jun 02 13:20:51.175758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 48/96] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:50 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:51.177860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-faa02936-d1b6-4fdd-ad4f-1681df1801a1 req-691cd97f-f898-4c18-ac0e-7d0b53e9a4ac service nova] Creating event network-changed:9b84ac82-613a-4b00-bcf2-9aeb7ab3b255 for instance 5d47700d-bd87-46b1-baae-0c9fb526d72b on hv-cinder-79760 Jun 02 13:20:51.187975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-faa02936-d1b6-4fdd-ad4f-1681df1801a1 req-691cd97f-f898-4c18-ac0e-7d0b53e9a4ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046085 Jun 02 13:20:51.188846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 49/97] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:20:51.220722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:51.221575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:51.227997 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.228445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.229208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.229659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.370810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.378346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b473cd40-fe9e-48db-bb9e-5369b4f952e0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.161525 Jun 02 13:20:51.378914 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 49/98] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:51 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:51.392778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:51.393552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:51.400710 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.401161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.402010 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.402367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.551613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.560529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-87996b8d-05f2-4ef6-9734-51963ae4901c tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.171993 Jun 02 13:20:51.561116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 50/99] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:51 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:51.584716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:51.585409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:51.593331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.593778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.594538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:51.595112 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:51.657905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.666646 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.668180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:51.669279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e9847ae0-394e-4df1-8ec4-a27ad3c73ae4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1334 microversion: 2.20 time: 0.088411 Jun 02 13:20:51.669856 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 50/100] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:51 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:52.192399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:52.201275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:52.201275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.201275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.201275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.201597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.358962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:52.369587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9b1ca19d-766c-43d5-b0e7-b445ea61e1eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.180358 Jun 02 13:20:52.370491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 51/101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:52 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:52.405887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:52.406499 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:52.414830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.415554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.416559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.417153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.577732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:52.578736 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:52.585396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.586148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.587124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.587767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.892876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:52.903192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c235e3a5-0812-461a-b414-88f290718ff6 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.329179 Jun 02 13:20:52.903782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 52/102] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:52 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:52.910361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:52.912171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:52.916372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:52.925608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-059b1f99-ebee-4212-a6cb-c6f5b5cbf954 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.532699 Jun 02 13:20:52.928404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.932678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 51/103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:52 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:52.932793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:52.932793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:52.932793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.199166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:53.209946 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:53.211394 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:53.218404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3ee6360f-df01-44eb-99ee-7efa109ef54a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1342 microversion: 2.20 time: 0.313363 Jun 02 13:20:53.220829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 53/104] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:52 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1342 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:53.386847 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:53.387226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:53.395362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.398851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.399668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.400134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.636507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:53.644488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-640529f1-001d-4b3a-9ecf-c5f4387fe146 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.261821 Jun 02 13:20:53.654297 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 52/105] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:53 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:53.924811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:53.925977 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:53.947601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:53.947601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:53.951048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.959973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.960954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.961421 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.963395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.963854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:53.964657 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:53.965099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.157140 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.168426 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-760afae7-a189-4b76-9dfd-c71e88668d0d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.227238 Jun 02 13:20:54.169600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 53/106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:53 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:54.275674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.282983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b248d9c-8c8d-4a3a-a92a-dac5d250b8eb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.364996 Jun 02 13:20:54.310508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 54/107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:53 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:20:54.322803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:54.324520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:54.336916 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:54.345934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-bfd7ba56-1eb2-4f5e-ad92-81e600d3d065 req-9a57f864-cc26-47e2-974d-17798b87f574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f653ea90-3377-4409-aefc-bd9db30f1841", "name": "network-vif-plugged", "status": "completed", "tag": "5294a6c8-3267-40ee-b768-877080b87580"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:54.346854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.350295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:54.350295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.374934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bfd7ba56-1eb2-4f5e-ad92-81e600d3d065 req-9a57f864-cc26-47e2-974d-17798b87f574 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:54.375382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bfd7ba56-1eb2-4f5e-ad92-81e600d3d065 req-9a57f864-cc26-47e2-974d-17798b87f574 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.415454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-bfd7ba56-1eb2-4f5e-ad92-81e600d3d065 req-9a57f864-cc26-47e2-974d-17798b87f574 service nova] Creating event network-vif-plugged:5294a6c8-3267-40ee-b768-877080b87580 for instance f653ea90-3377-4409-aefc-bd9db30f1841 on hv-cinder-79760 Jun 02 13:20:54.431709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-bfd7ba56-1eb2-4f5e-ad92-81e600d3d065 req-9a57f864-cc26-47e2-974d-17798b87f574 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257362 Jun 02 13:20:54.434398 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 54/108] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:20:54.543547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.552126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.554189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.555332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6700400d-4e0b-4c83-b74e-4fbdcacdee1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.240876 Jun 02 13:20:54.555907 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 55/109] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:54 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:54.663138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:54.663965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:54.670505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:54.671169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.672046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:54.672560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:54.821235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:54.828648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fb18aed4-3bb6-4662-9d2e-67c83b658887 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.170632 Jun 02 13:20:54.829369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 55/110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:54 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:55.185768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:55.186379 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:55.192473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.193597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.194398 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.194822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.302363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:55.303163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:55.310464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.310918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.311859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.320205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.341823 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:55.349436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-96fbd502-7ea4-4665-806a-5082299a6d7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.167443 Jun 02 13:20:55.350002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 56/111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:55 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:55.450489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:55.475105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-68e87f71-ed01-4101-8e0f-0b0b7c294546 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.161132 Jun 02 13:20:55.475105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 56/112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:55 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:55.577935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:55.578536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:55.584578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.585017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.585840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.586267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.752224 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:55.754779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:55.761119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:55.762756 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:55.764047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b42db16-6f1a-4d31-ba45-345ce72ad892 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.190168 Jun 02 13:20:55.764686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 57/113] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:55 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:55.851175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:55.851784 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:55.854222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=20 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:55.861533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.861978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:55.862797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:55.863615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.002482 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:56.010023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e3fde65b-7962-4f1f-9125-7ee0e38d2ef2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.163153 Jun 02 13:20:56.010595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 57/114] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:55 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:56.366466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:56.367076 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:56.373087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.373533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.374350 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.374791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.462541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-73231a58-d5de-4509-8676-84d048ac66b9 req-117283d3-1ea6-4a80-9a3f-520509f094d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d47700d-bd87-46b1-baae-0c9fb526d72b", "name": "network-vif-plugged", "status": "completed", "tag": "9b84ac82-613a-4b00-bcf2-9aeb7ab3b255"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:20:56.481910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-73231a58-d5de-4509-8676-84d048ac66b9 req-117283d3-1ea6-4a80-9a3f-520509f094d2 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.482582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-73231a58-d5de-4509-8676-84d048ac66b9 req-117283d3-1ea6-4a80-9a3f-520509f094d2 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.500206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-73231a58-d5de-4509-8676-84d048ac66b9 req-117283d3-1ea6-4a80-9a3f-520509f094d2 service nova] Creating event network-vif-plugged:9b84ac82-613a-4b00-bcf2-9aeb7ab3b255 for instance 5d47700d-bd87-46b1-baae-0c9fb526d72b on hv-cinder-79760 Jun 02 13:20:56.500206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-73231a58-d5de-4509-8676-84d048ac66b9 req-117283d3-1ea6-4a80-9a3f-520509f094d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051716 Jun 02 13:20:56.503703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 58/115] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:20:56.512929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:56.513627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:56.515076 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:56.520278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.521376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.522147 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.522580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.524173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0f73098c-5a97-4406-a594-999576d3028c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.161548 Jun 02 13:20:56.524860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 58/116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:56 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:56.693732 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:56.705502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-86136056-4b11-4ff0-bc11-441302bf9e85 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.196945 Jun 02 13:20:56.707839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 59/117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:56 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:56.786363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:56.786363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:56.787780 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:56.790430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.791104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:56.792002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:56.792514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.026969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:57.027578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:57.033691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.034143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.034911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.035345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.102620 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.115990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.119366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.119366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-41d38053-dda3-495f-806e-408cb1075dea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.341161 Jun 02 13:20:57.120176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 59/118] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:56 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:57.194433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.202357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05182679-0775-4dc6-968f-771db4bee492 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.179610 Jun 02 13:20:57.203182 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 60/119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:57 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:57.541820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:57.542568 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:57.549060 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.549778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.550533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.551005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.695081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.702549 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-df288331-fd49-490f-8fd3-c53e586c7f99 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.164591 Jun 02 13:20:57.703112 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 60/120] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:57 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:57.728080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:57.728767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:57.734747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.735193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.735994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:57.736429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:57.869658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:57.883049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a928f140-58b8-4987-84d6-0e775d5a6edd tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.159627 Jun 02 13:20:57.888598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 61/121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:57 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:58.137168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:58.137783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:58.144275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.152051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.152051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.152051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.221421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:58.222179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:58.224220 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:58.229122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.229763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.230536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.230970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.374621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:58.382940 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-486cb8ec-aad7-4c36-9b73-b3ed39ba9176 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.166539 Jun 02 13:20:58.384157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 62/122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:58 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:58.440223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:58.449150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:58.450658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:58.451918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4a662d6e-edc4-425b-9ae5-ab5cf19c506c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.318745 Jun 02 13:20:58.452491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 61/123] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:58 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:20:58.721037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:58.721890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:58.738537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.738537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.738537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.738537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.870081 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:58.877960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b845c213-6dae-41c7-9f4b-b3667625f222 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.162512 Jun 02 13:20:58.878614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 63/124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:58 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:58.909390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:58.910505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:58.920788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.921531 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:58.922807 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:58.923532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.083095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:59.093004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc23e9ed-b039-49b3-ab8b-7ee5c386b339 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.190170 Jun 02 13:20:59.093644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 62/125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:58 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:59.400307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:59.401402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:59.407611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.408144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.408981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.409426 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.414347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:59.471601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:59.472288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:59.479578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.488095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.488095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.488095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.555961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:59.564160 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-deadbbed-2055-498d-b5ee-eeac5d88968a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.167950 Jun 02 13:20:59.564742 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 64/126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:59 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:20:59.674337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:59.683461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:59.683795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:20:59.685117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c05d901d-9a6a-43ee-8d71-cc58993e4421 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.217992 Jun 02 13:20:59.685675 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 63/127] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:20:59 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:20:59.896424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:20:59.897042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:20:59.903484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.903668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:20:59.904548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:20:59.904935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.110149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:00.110917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:00.117425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.117881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.118670 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.119102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.274272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.283386 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3238f70-8d5e-4ac5-9fa2-48e97d601740 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.176937 Jun 02 13:21:00.292915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 64/128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:00 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:00.404220 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.411436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-481e900f-11cd-4b79-a71f-53744265f843 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.520619 Jun 02 13:21:00.412245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 65/129] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:20:59 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:00.584530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:00.585161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:00.591366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.591799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.592576 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.593013 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.705852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:00.706475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:00.713223 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.714166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.715390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:00.716067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:00.758104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.769832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8c8769c7-6a7b-435d-8dce-4f50ffa823e3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.186318 Jun 02 13:21:00.769832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 65/130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:00 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:00.852588 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.860883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.862401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:00.863523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-94dab1d2-0074-41f5-ba1a-8ff7edad674e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.161711 Jun 02 13:21:00.864153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 66/131] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:00 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:01.300385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:01.300991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:01.307623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.315433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.315433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.315433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.428958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:01.429563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:01.435615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.436103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.437084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.437857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.444417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:01.453327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2086a49e-6c0e-481e-95df-4fe72dfcdda0 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.156552 Jun 02 13:21:01.463453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 66/132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:01 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:01.625011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:01.633810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-99e96fa5-b9d3-43a5-882a-ab511885fbf9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.208761 Jun 02 13:21:01.643945 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 67/133] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:01 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:01.784853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:01.785706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:01.791926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.792366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.793117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.794467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.883138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:01.884309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:01.891129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.892030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:01.892946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:01.895418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:02.061816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.070790 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-40a1abcb-9933-4dc4-adb8-962e6da26347 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.289709 Jun 02 13:21:02.071904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 67/134] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:01 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:02.112668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.122676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.124447 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.126022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-266b46b3-4408-4349-aaf4-5d52ca4cc219 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.247983 Jun 02 13:21:02.127308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 68/135] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:01 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:02.473881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:02.475181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:02.490225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:02.490675 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:02.491504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:02.492029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:02.651710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:02.652495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:02.658870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:02.660933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:02.663240 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:02.663976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:02.669199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.680261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-36f66e3a-e511-4304-a020-1a8adcb8b3ba tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.210568 Jun 02 13:21:02.682239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 68/136] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:02 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:02.875147 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:02.887231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-47be34cf-52f6-4d64-aeff-a4088d92c9c4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.239458 Jun 02 13:21:02.887813 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 69/137] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:02 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:03.089462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:03.090308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:03.096745 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.097220 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.097983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.098448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.146823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:03.147448 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:03.157582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.158071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.160405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.160893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.300416 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:03.308102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bd1a07a9-409c-4a9e-89f6-07d68d400bcd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.223197 Jun 02 13:21:03.308685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 69/138] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:03 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:03.313914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-28ce05b8-4dca-4aa6-abc0-23c27e5c37de req-92734353-e02d-4a53-bef2-18d8ab677965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:03.318094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:03.324910 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-28ce05b8-4dca-4aa6-abc0-23c27e5c37de req-92734353-e02d-4a53-bef2-18d8ab677965 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.325345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-28ce05b8-4dca-4aa6-abc0-23c27e5c37de req-92734353-e02d-4a53-bef2-18d8ab677965 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.327245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:03.329059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:03.330377 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b6d36e59-83ed-4b59-921a-34c693488c42 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.189002 Jun 02 13:21:03.343556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 70/139] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:03 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:03.343699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-28ce05b8-4dca-4aa6-abc0-23c27e5c37de req-92734353-e02d-4a53-bef2-18d8ab677965 service nova] Creating event network-changed:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:21:03.343699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-28ce05b8-4dca-4aa6-abc0-23c27e5c37de req-92734353-e02d-4a53-bef2-18d8ab677965 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Jun 02 13:21:03.346119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 70/140] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:03.699260 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:03.700476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:03.707416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.708142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.709068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.709665 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.793180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-ff908df3-ce8f-455c-8b80-b2881bb86bac req-dc05de16-98fb-4173-af09-f8525b78f855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924c7837-38cd-4d99-bc12-6d1631a6fd43", "name": "network-vif-plugged", "status": "completed", "tag": "a385ba1f-8741-43e7-8512-5ec1a8ccf941"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:03.808957 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ff908df3-ce8f-455c-8b80-b2881bb86bac req-dc05de16-98fb-4173-af09-f8525b78f855 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.809648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ff908df3-ce8f-455c-8b80-b2881bb86bac req-dc05de16-98fb-4173-af09-f8525b78f855 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.824663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-ff908df3-ce8f-455c-8b80-b2881bb86bac req-dc05de16-98fb-4173-af09-f8525b78f855 service nova] Creating event network-vif-plugged:a385ba1f-8741-43e7-8512-5ec1a8ccf941 for instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 on hv-cinder-79760 Jun 02 13:21:03.832739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-ff908df3-ce8f-455c-8b80-b2881bb86bac req-dc05de16-98fb-4173-af09-f8525b78f855 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046001 Jun 02 13:21:03.832739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 71/141] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:21:03.872218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:03.879965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d17e5917-92fc-420d-8294-735ff7c55019 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.184725 Jun 02 13:21:03.880543 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 71/142] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:03 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:03.906094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:03.906806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:03.918452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.918452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:03.918452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:03.918452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.112608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:04.122945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0d92e3db-26bc-4b76-81b0-159fce0d29df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.221495 Jun 02 13:21:04.124106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 72/143] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:03 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:04.325806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:04.326330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:04.332585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.333564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.334573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.335011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.351980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:04.352698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:04.360117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.360596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.361414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.361852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.475339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:04.483554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6859b669-9f38-42ba-bbdf-75cec4e56cc7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.161054 Jun 02 13:21:04.484169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 72/144] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:04 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:04.498269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:04.506837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:04.508363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:04.509476 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c303c2ce-da7a-4cdf-83e4-25ccbbbafb52 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.162647 Jun 02 13:21:04.510038 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 73/145] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:04 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:04.897322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:04.897843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:04.903793 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.904261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:04.905001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:04.905431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.095193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.103892 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5e0c8695-f0bf-4414-8a53-919313be7426 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1315 microversion: 2.1 time: 0.210403 Jun 02 13:21:05.119352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 73/146] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:04 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:05.140170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:05.140922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:05.146527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.146993 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.147805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.148212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.497913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.500812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:05.501495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:05.505482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4dd0fa72-7497-483b-96b2-eac0d6236ed6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.369794 Jun 02 13:21:05.508276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.508791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.509792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.510325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.514835 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 74/147] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:05 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:05.527248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:05.528051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:05.534879 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.536353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.537327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.538041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.709281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.711079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.711252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:05.719846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.720481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f7e0b762-e8c6-45c3-9e8e-d66593b12e5a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.223628 Jun 02 13:21:05.721981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 74/148] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:05 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:05.724844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:05.725980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e390938b-971e-4aa5-859f-678ee1705f07 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.202537 Jun 02 13:21:05.726529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 75/149] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:05 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:05.850214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-bb9aa3d6-7683-497a-95b3-94548f93fa23 req-f8a10d33-dec7-479b-b2a6-b3664f24a7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e59264d-5544-48cd-a508-5c7b119cfeae", "name": "network-vif-plugged", "status": "completed", "tag": "1b1f8072-eaa6-4034-99a8-a965c894139b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:05.856940 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bb9aa3d6-7683-497a-95b3-94548f93fa23 req-f8a10d33-dec7-479b-b2a6-b3664f24a7fd service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:05.857377 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bb9aa3d6-7683-497a-95b3-94548f93fa23 req-f8a10d33-dec7-479b-b2a6-b3664f24a7fd service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:05.869576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-bb9aa3d6-7683-497a-95b3-94548f93fa23 req-f8a10d33-dec7-479b-b2a6-b3664f24a7fd service nova] Creating event network-vif-plugged:1b1f8072-eaa6-4034-99a8-a965c894139b for instance 1e59264d-5544-48cd-a508-5c7b119cfeae on hv-cinder-79760 Jun 02 13:21:05.875185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-bb9aa3d6-7683-497a-95b3-94548f93fa23 req-f8a10d33-dec7-479b-b2a6-b3664f24a7fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Jun 02 13:21:05.875983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 75/150] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:06.120632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:06.121229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:06.127370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.127816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.128782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.129210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.269082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.276940 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-99fcb52a-767d-4052-95cb-48bffce4cc0a tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1500 microversion: 2.1 time: 0.160193 Jun 02 13:21:06.277506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 76/151] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:06 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:06.521701 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:06.522985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:06.531710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.532194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.532962 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.533395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.673864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.681716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eff17cf7-c913-4a48-9045-4ffa0300aaa0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.164230 Jun 02 13:21:06.682286 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 76/152] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:06 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:06.738812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:06.740311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:06.751386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:06.751386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:06.751559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.751559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.751559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.751559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.751924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.751924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.752098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:06.752395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:06.886784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.888030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.894448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07a37f97-ac73-42f8-8a4b-b1d0d8a76fa9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.159559 Jun 02 13:21:06.904359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 77/153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:06 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:06.904533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.904533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:06.904533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f944733a-7af1-4eb7-a2bc-ce0db31990c3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.158371 Jun 02 13:21:06.904784 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 77/154] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:06 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:07.699288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:07.699996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:07.706522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.706966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:07.707809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.708280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:07.861644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:07.869528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-53d34367-1231-4d06-af71-ac4348502b66 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1322 microversion: 2.1 time: 0.174463 Jun 02 13:21:07.870110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 78/155] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:07 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:07.912768 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:07.914156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:07.918141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:07.918715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:07.920939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.921384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:07.922305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.922778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:07.925079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.925724 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:07.926519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:07.928260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:08.064848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:08.080657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:08.084107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:08.085970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5686a9c7-7aaa-4527-8184-a337d14a0831 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.171772 Jun 02 13:21:08.087059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 79/156] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:07 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:08.122116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:08.133319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f279e560-c6f4-4097-b045-da85fcadfe23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.224843 Jun 02 13:21:08.135181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 78/157] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:07 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:08.179999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1feb1761-0f67-4bbb-b842-2e6d7e01f676"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:08.181322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:08.184515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:08.188108 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:08.188628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:08.189503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:08.190150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:08.886816 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:08.887419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:08.893499 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:08.893964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:08.897783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:08.897783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.023269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:09.032794 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d2e736a9-bf26-474d-ae83-85c79f43d0b7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1516 microversion: 2.1 time: 0.149850 Jun 02 13:21:09.033375 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 79/158] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:08 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:09.050655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:09.052353 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:09.058540 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.059224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.060204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.060694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.123571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'flavor' on Instance uuid 924c7837-38cd-4d99-bc12-6d1631a6fd43 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:21:09.187406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:09.535131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-adab14e3-69ce-48f9-ba9b-78c575846619 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43/action" status: 200 len: 32 microversion: 2.1 time: 0.488252 Jun 02 13:21:09.537026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 80/159] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:21:09 2022] POST /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:21:09.543249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:09.544090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:09.552721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.553319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.554308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.554874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.727550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:09.736117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:09.737627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:09.738872 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-57aa43ec-d8b0-4f12-ba0e-ac29f201f50e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.200355 Jun 02 13:21:09.749046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 81/160] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:09 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:09.749046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:09.749046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:09.751224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.751669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.752458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.752886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.891918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:09.904411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-62a69145-700f-43b2-8a4f-28973e0649bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.159115 Jun 02 13:21:09.904411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 82/161] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:09 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:09.904725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:09.905487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:09.912524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.912977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:09.913731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:09.914161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:10.062633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:10.070726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-530fd9b3-a779-437c-beda-03245ed1e74c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.169754 Jun 02 13:21:10.071291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 83/162] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:09 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:10.757103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:10.757701 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:10.764460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:10.764915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:10.765681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:10.766119 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:10.897767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:10.906041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:10.907888 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:10.909137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f64e35dd-13b1-494d-8105-4cba918e466b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.156480 Jun 02 13:21:10.909943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 84/163] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:10 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:10.929271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:10.929935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:10.933841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:10.937357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:10.938214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:10.939451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:10.940124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:11.075481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:11.084717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-71d7aa95-82c2-49d4-98e1-9de110fa6396 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.162630 Jun 02 13:21:11.085300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 85/164] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:10 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:11.090550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:11.091326 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:11.097246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:11.097736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:11.098575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:11.099004 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:11.274056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:11.281591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-368db4b7-6be5-4379-81ab-8ad5b70fb8e9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.195300 Jun 02 13:21:11.282205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 86/165] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:11 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:11.927127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:11.927733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:11.933582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:11.934023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:11.934777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:11.935216 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:12.073475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:12.082162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:12.084393 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:12.085544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fad720e5-7ea7-4288-b56b-c91a19da0f05 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.162380 Jun 02 13:21:12.086102 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 87/166] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:11 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:12.102056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:12.102771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:12.109179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:12.109710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:12.110641 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:12.111149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:12.241049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:12.248808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7646baa2-a6be-464d-804b-683efa545c53 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.151392 Jun 02 13:21:12.249483 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 88/167] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:12 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:12.299677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:12.300246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:12.307672 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:12.308158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:12.308941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:12.309445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:12.452577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:12.460328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0b00f46c-3b39-4b68-b02c-418ba9db4d9e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.164600 Jun 02 13:21:12.461127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 89/168] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:12 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:13.105680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:13.106346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:13.112826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.113457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.114416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.115099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.242184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:13.250017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:13.251514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:13.252690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-784b1fcc-028e-4869-930e-944b99bdf910 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.152052 Jun 02 13:21:13.253251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 90/169] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:13 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:13.266259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:13.266856 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:13.275083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.275531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.276332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.276767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.416288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:13.423708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5e825b21-b82e-4f79-b6b4-35fab059edbc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.161096 Jun 02 13:21:13.426145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 91/170] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:13 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:13.476619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:13.477224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:13.483161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.483613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.486848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:13.486848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:13.617371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:13.626386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0c4f7e06-dd74-4311-a1ce-26e3110c1aef tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.153460 Jun 02 13:21:13.627124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 92/171] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:13 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:14.270541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:14.271155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:14.277175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.277619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.278379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.278867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.402994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:14.411411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:14.412955 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:14.414081 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-714072d3-c116-4744-84d0-b1a92958d495 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.147537 Jun 02 13:21:14.414641 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 93/172] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:14 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:14.440786 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:14.441385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:14.447531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.447899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.448673 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.449148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.583957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:14.591726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e966c1c-9725-4804-b8b8-81ae95b7f8dc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.154674 Jun 02 13:21:14.592338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 94/173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:14 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:14.644258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:14.645196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:14.651486 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.652072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.652855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:14.653286 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:14.802973 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:14.810419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bfc1de4f-90de-4316-a3bf-5d4be27aaf8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.170434 Jun 02 13:21:14.810988 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 95/174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:14 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:15.583381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:15.583381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:15.583381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.583381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.584136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.584136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.584136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:15.584372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:15.584372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:15.584552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:15.584552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e515c11f-e557-49c1-9582-bf12792f22b3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.148499 Jun 02 13:21:15.584552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 96/175] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:15 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:15.608642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:15.653410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:15.653410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.653410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.653410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.653890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.742959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:15.750953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f580c96c-5c0b-41e7-a574-d413dbd0b8f7 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.145963 Jun 02 13:21:15.751569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 97/176] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:15 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:15.827894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:15.828505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:15.835288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.835735 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.836525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:15.836961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:15.968662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:15.976013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8bc2080c-b8d5-49ca-a3d9-2c6845ff7dc7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.152039 Jun 02 13:21:15.976589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 98/177] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:15 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:16.594456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:16.595065 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:16.602243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:16.604669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:16.604669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:16.604669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:16.733231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:16.741913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:16.743524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:16.744747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05c9b963-24a6-4f25-be63-8057ab353dfb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.154162 Jun 02 13:21:16.745419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 99/178] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:16 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:16.768714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:16.773779 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:16.776717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:16.777159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:16.777915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:16.778368 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:16.924693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:16.932602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4da233da-5d89-482e-8765-00c2a7c6cf7f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.167761 Jun 02 13:21:16.939164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 100/179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:16 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:16.993079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:16.993709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:16.999725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.000206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:17.000957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.001441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:17.131683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:17.139137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cd958902-f61d-4e92-97a4-9d5ce8bc511a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.149777 Jun 02 13:21:17.139912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 101/180] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:16 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:17.762778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:17.763410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:17.769278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.774692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:17.774692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.774692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:17.907029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:17.916079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:17.917819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:17.918936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e16924a9-6f2c-4d6a-a3bc-38f509e7b7f2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.160284 Jun 02 13:21:17.919645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 102/181] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:17 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:17.950661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:17.951265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:17.960053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.960508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:17.961281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:17.961718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:18.097229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:18.105023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-27564402-7cc8-48ca-a087-871c26c483c4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.158294 Jun 02 13:21:18.105661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 103/182] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:17 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:18.156576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:18.157187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:18.164229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:18.164690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:18.165439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:18.165874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:18.300245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:18.302561 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=31 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.310936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4a301937-386e-47ee-9080-67ccb398c7b4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.157742 Jun 02 13:21:18.311647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 104/183] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:18 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:18.939653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:18.940582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:18.950359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:18.951044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:18.951926 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:18.952452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:19.139900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:19.148140 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:19.149659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:19.150764 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3649b98d-dfae-4e39-b3e4-19cbd2f0e2ab tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.216280 Jun 02 13:21:19.151639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 105/184] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:18 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:19.156054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:19.156843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:19.162939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:19.163385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:19.164173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:19.164606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:19.308445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:19.316098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-06164635-a5be-4740-a643-28793ccbc2f9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.163409 Jun 02 13:21:19.317354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 106/185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:19 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:19.328526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:19.328734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:19.335050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:19.335502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:19.336299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:19.336739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:19.493012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:19.504350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c5bfe37-6164-4edc-9d20-ce09bc56aadb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.178162 Jun 02 13:21:19.504350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 107/186] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:19 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:20.168731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:20.169363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:20.175467 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.176519 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.177286 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.178395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.312043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:20.320915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:20.322428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:20.323547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1b372e7b-94ad-4e09-905a-354907e43ac2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.158940 Jun 02 13:21:20.324160 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 108/187] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:20 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:20.334677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:20.334677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:20.341632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.342071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.342829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.343254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.475601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:20.484233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8068e474-c3bf-4389-b055-07505ec105bc tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.154328 Jun 02 13:21:20.484806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 109/188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:20 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:20.518420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:20.519018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:20.525195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.525639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.526398 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:20.526830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:20.669436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:20.677851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cfcef479-191e-423a-b112-46bd5f1bfd24 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.163071 Jun 02 13:21:20.678456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 110/189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:20 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:21.342186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:21.342838 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:21.348967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.349413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.350170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.350599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.492982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:21.501579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:21.503074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:21.504848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b4f3cbbe-f8c1-47b0-b992-504e5e3d84d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.165930 Jun 02 13:21:21.505404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 111/190] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:21 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:21.509846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:21.510355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:21.516400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.516895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.517593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.518019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.655388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:21.663016 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:21.670725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ed533e8-6308-43f5-afee-7c62f9265cfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.163769 Jun 02 13:21:21.671678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 112/191] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:21 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:21.698317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:21.699765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:21.706334 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.706781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.708202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:21.708637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:21.857464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:21.868992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c140b54d-47f8-41bd-a811-96d783474069 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.177268 Jun 02 13:21:21.869583 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 113/192] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:21 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:22.522709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:22.523376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:22.529497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.529943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:22.530698 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.531126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:22.657026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:22.665418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:22.666934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:22.668068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d9aaf3b6-832f-40f5-a446-efd7ea4bf6bd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.149514 Jun 02 13:21:22.668621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 114/193] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:22 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:22.687715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:22.688378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:22.694607 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.695044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:22.695785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.696250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:22.825748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:22.833606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c49d771-0d69-49ba-b65c-5878a0c8b0de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.149475 Jun 02 13:21:22.834168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 115/194] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:22 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:22.886638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:22.887249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:22.893632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.894082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:22.895361 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:22.895793 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:23.026105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:23.036417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e511af79-6259-4407-af80-ff4e129b096e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.150766 Jun 02 13:21:23.036417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 116/195] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:22 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:23.686471 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:23.687095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:23.693823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:23.694291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:23.695046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:23.695476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:23.822040 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:23.830900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:23.833010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:23.834231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3c9e5e7b-373f-4459-bc59-20043f50cff9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.151610 Jun 02 13:21:23.834788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 117/196] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:23 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:23.850874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:23.851468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:23.857832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:23.858278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:23.859172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:23.859603 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:23.992343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:24.003008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a2468680-3f8c-4278-901e-feaadbe84613 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1362 microversion: 2.1 time: 0.156173 Jun 02 13:21:24.004405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 118/197] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:23 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:24.050788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:24.051395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:24.060418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:24.060926 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:24.061719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:24.062130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:24.207473 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:24.215447 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d7aaeba5-a7b2-473f-b599-5c6a979791f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.168489 Jun 02 13:21:24.216244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 119/198] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:24 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:24.852799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:24.853526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:24.859581 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:24.860093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:24.860857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:24.861287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:24.993159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:25.001165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:25.002869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:25.004037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-64688ee2-ebd5-4038-a73a-b746d525fda7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.155257 Jun 02 13:21:25.004748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 120/199] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:24 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:25.024303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:25.024303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:25.028267 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.028719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.029500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.029931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.167197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:25.177115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2fe3f140-8d61-48ac-95ce-7dbda826d338 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1548 microversion: 2.1 time: 0.159862 Jun 02 13:21:25.177863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 121/200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:25 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:25.199969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:25.200524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:25.207328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.207943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.214432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.214432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.345240 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e61f29a2-0a99-420c-8712-d1a2f71d475b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151758 Jun 02 13:21:25.346058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 122/201] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:21:25 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:21:25.351294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:25.360548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:25.360548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.360548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.360548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:25.361446 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:25.629986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:25.639569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a6ab8d30-d056-43db-bd86-c5b73e866c96 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.292439 Jun 02 13:21:25.640614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 123/202] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:25 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:25.978850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-647d0457-d820-4d86-895d-a3d0b5080073 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "POST /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.803564 Jun 02 13:21:25.979525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 80/203] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:21:08 2022] POST /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841/os-volume_attachments => generated 194 bytes in 17805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:26.022737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:26.023514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:26.030776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:26.031664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:26.036653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:26.036653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:26.180069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:26.188732 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:26.192165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:26.193303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-874ed8d7-f1e1-457a-a3a2-a2050bfafbac tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.175385 Jun 02 13:21:26.193927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 124/204] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:26 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:26.658593 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:26.659292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:26.666507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:26.666886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:26.667690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:26.668144 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:26.908772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-81c48a15-4a65-47af-b52a-5a70a0e3c49c req-6d7babbd-832e-4421-97a6-aa6b67e433b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e59264d-5544-48cd-a508-5c7b119cfeae", "tag": "1b1f8072-eaa6-4034-99a8-a965c894139b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:26.911294 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:26.919324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7cd9bcec-edba-43e6-a872-6daa6bd2b909 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.265692 Jun 02 13:21:26.919470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-81c48a15-4a65-47af-b52a-5a70a0e3c49c req-6d7babbd-832e-4421-97a6-aa6b67e433b6 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:26.920080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 81/205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:26 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:26.920188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-81c48a15-4a65-47af-b52a-5a70a0e3c49c req-6d7babbd-832e-4421-97a6-aa6b67e433b6 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:26.932441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-81c48a15-4a65-47af-b52a-5a70a0e3c49c req-6d7babbd-832e-4421-97a6-aa6b67e433b6 service nova] Creating event network-changed:1b1f8072-eaa6-4034-99a8-a965c894139b for instance 1e59264d-5544-48cd-a508-5c7b119cfeae on hv-cinder-79760 Jun 02 13:21:26.937671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-81c48a15-4a65-47af-b52a-5a70a0e3c49c req-6d7babbd-832e-4421-97a6-aa6b67e433b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032531 Jun 02 13:21:26.940412 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 125/206] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:27.211760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:27.212601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:27.218732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:27.219290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:27.220069 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:27.220498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:27.360369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:27.368968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:27.370470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:27.371578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3d32db43-8d68-4935-8590-c4b792942701 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.164757 Jun 02 13:21:27.372168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 82/207] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:27 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:27.937132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:27.938170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:27.945298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:27.945740 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:27.946532 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:27.947124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:28.094869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:28.103044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4190eeeb-941f-495b-bc0f-6df71e2681c1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.170416 Jun 02 13:21:28.105094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 126/208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:27 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:28.281635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-ba951226-0993-49dd-8b2b-031966e36a57 req-a760862f-f4a7-4848-83fc-809d503451a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "name": "network-vif-plugged", "status": "completed", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:28.291130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ba951226-0993-49dd-8b2b-031966e36a57 req-a760862f-f4a7-4848-83fc-809d503451a8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:28.291560 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ba951226-0993-49dd-8b2b-031966e36a57 req-a760862f-f4a7-4848-83fc-809d503451a8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:28.302475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-ba951226-0993-49dd-8b2b-031966e36a57 req-a760862f-f4a7-4848-83fc-809d503451a8 service nova] Creating event network-vif-plugged:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:21:28.307513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-ba951226-0993-49dd-8b2b-031966e36a57 req-a760862f-f4a7-4848-83fc-809d503451a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029550 Jun 02 13:21:28.308182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 83/209] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:28.392251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:28.398404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:28.404910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:28.405436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:28.406359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:28.406864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:28.537934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:28.546509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:28.553174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:28.553174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5e71d02c-7215-4c50-9b67-3e4a0655794b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.162529 Jun 02 13:21:28.553174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 127/210] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:28 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:29.126236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:29.127278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:29.135829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:29.136356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:29.137259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:29.137697 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:29.291675 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:29.300679 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f3adb9cf-757c-4cf1-bc4f-1806032bcbff tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.181011 Jun 02 13:21:29.301286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 84/211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:29 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:29.568092 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:29.572565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:29.574792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:29.575231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:29.576005 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:29.576431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:29.701697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:29.709704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:29.711255 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:29.712691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cf43184f-d45e-43e0-a809-dfe21ed03d46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.149101 Jun 02 13:21:29.713251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 128/212] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:29 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:30.329297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:30.329913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:30.342195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:30.344566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:30.344566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:30.344566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:30.489931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:30.497535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9a3693c1-214f-4d47-9817-b3846b328376 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.172022 Jun 02 13:21:30.505646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 85/213] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:30 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:30.732654 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:30.733305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:30.742547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:30.743191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:30.744395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:30.744901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:31.067720 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:31.089226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:31.093126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:31.094493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d3642d6c-adc4-46cf-9f48-38231b9fea32 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.367726 Jun 02 13:21:31.095056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 129/214] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:30 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:31.515598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:31.516862 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:31.524413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:31.524932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:31.526058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:31.526497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:31.807952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:31.815564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-40a3b4f9-bbaa-468c-b152-0ae7fec52730 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.304668 Jun 02 13:21:31.816391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 86/215] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:31 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:32.111780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:32.112434 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:32.118715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:32.119208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:32.119988 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:32.120586 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:32.139213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:32.255969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:32.263986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:32.265553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:32.266657 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f33a502-c193-48f4-a712-a4278738dc1f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.158783 Jun 02 13:21:32.267224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 130/216] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:32 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:32.833108 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:32.833847 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:32.840504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:32.840946 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:32.841698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:32.842128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:32.976395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:32.985017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f3e9756-d218-4933-8e96-20a053495346 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.156040 Jun 02 13:21:32.985698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 87/217] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:32 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:33.284386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:33.285490 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:33.291819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:33.292289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:33.293042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:33.293469 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:33.422355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:33.430372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:33.431912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:33.433006 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25385457-5ed2-449e-a5ff-af156ff62fe1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.152876 Jun 02 13:21:33.433560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 131/218] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:33 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:34.001586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:34.002191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:34.009212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:34.009655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:34.010418 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:34.010851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:34.137915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:34.146086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-611557eb-18aa-4a7b-9317-7d9f8100937c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.148275 Jun 02 13:21:34.146660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 88/219] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:33 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:34.450905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:34.451515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:34.458119 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:34.458553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:34.459297 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:34.459725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:34.587754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:34.595927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:34.597823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:34.599024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0815e88b-7223-40fe-b7ad-85d3624f8618 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.152421 Jun 02 13:21:34.599594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 132/220] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:34 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:35.163081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:35.163686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:35.170174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:35.170618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:35.171371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:35.171805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:35.297232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:35.305489 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-55eb57b4-1ab6-454c-9c32-62fd4c4bca93 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.146153 Jun 02 13:21:35.306055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 89/221] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:35 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:35.616646 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:35.617246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:35.626401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:35.626401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:35.626401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:35.626401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:35.752523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:35.760656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:35.762163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:35.763252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6f4262c9-6d67-4066-965b-e56d518886aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.151079 Jun 02 13:21:35.763797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 133/222] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:35 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:36.323522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:36.324056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:36.330475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:36.330914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:36.331657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:36.332119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:36.466289 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:36.474129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9b937d4a-b3e6-46eb-b97c-051b72fed309 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.155036 Jun 02 13:21:36.475055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 90/223] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:36 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:36.781509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:36.782143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:36.788951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:36.789392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:36.790256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:36.790570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:36.928666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:36.936748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:36.938522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:36.939637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aecfd3c5-f765-40ad-90f8-71ce777b1d69 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.162052 Jun 02 13:21:36.940518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 134/224] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:36 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:37.496355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:37.497184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:37.504132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:37.504580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:37.505346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:37.505784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:37.634166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:37.641454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ca7a3217-806c-4b48-92aa-322601c77a7e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.149016 Jun 02 13:21:37.642015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 91/225] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:37 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:37.957326 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:37.957933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:37.959831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:37.964870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:37.965316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:37.966075 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:37.966506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:38.095700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:38.104358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:38.105868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:38.106965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3b27d0f3-9624-49dc-8d19-c2741c9505f6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.153650 Jun 02 13:21:38.107524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 135/226] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:37 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:38.658375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:38.658894 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:38.664990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:38.665429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:38.666176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:38.666606 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:38.790927 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:38.799898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d3f63f16-ab9e-4d70-8eb8-f89f44ee6736 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.145555 Jun 02 13:21:38.800472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 92/227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:38 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:39.125091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:39.125695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:39.132202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:39.132681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:39.133481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:39.133869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:39.259205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:39.267044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:39.268584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:39.269677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-64f05fdd-2e9c-4100-a134-c7a17346e645 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.148599 Jun 02 13:21:39.270259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 136/228] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:39 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:39.816224 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:39.816770 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:39.823834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:39.824311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:39.825070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:39.825510 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:39.956273 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:39.964567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fb343057-33fb-4ea1-911a-4a799d44490a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.152287 Jun 02 13:21:39.965128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 93/229] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:39 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:40.287741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:40.288392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:40.294528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:40.294971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:40.295705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:40.296158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:40.431835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:40.439651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:40.441185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:40.442306 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-df7da90c-4950-46e8-b561-af6e5240005d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.158432 Jun 02 13:21:40.442863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 137/230] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:40 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:40.981580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:40.982187 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:40.988665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:40.989086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:40.989832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:40.990286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:41.115501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:41.122928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d3666179-f136-4577-b362-0ecad205c4d0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.145113 Jun 02 13:21:41.123493 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 94/231] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:40 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:41.460866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:41.461400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:41.467718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:41.468197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:41.468958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:41.469390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:41.597931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:41.605777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:41.607320 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:41.608437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-75c5c9b0-1509-46eb-8a1b-784d364fc8a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.152307 Jun 02 13:21:41.608991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 138/232] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:41 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:42.139741 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:42.140392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:42.146822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:42.147266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:42.148064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:42.148501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:42.279546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:42.287667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c0c28824-a195-428b-83b1-22f1c027f944 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.151143 Jun 02 13:21:42.288333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 95/233] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:42 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:42.626599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:42.627194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:42.633894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:42.634329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:42.635072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:42.635498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:42.761983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:42.771339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:42.772929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:42.774069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-48f76831-c26d-4a9e-92ea-c774ad7b5525 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.151337 Jun 02 13:21:42.774625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 139/234] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:42 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:43.304183 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:43.304867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:43.311315 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:43.311758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:43.312614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:43.313049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:43.447563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:43.451055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:43.455335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1b0105d1-d999-4d97-a344-9a1e022120f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.155092 Jun 02 13:21:43.455973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 96/235] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:43 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:43.792879 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:43.792879 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:43.798852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:43.799311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:43.800083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:43.800513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:43.936416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:43.945126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:43.946619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:43.947712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-801a8230-89fa-4936-b8a7-f4cb93ca8fbb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.159837 Jun 02 13:21:43.948315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 140/236] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:43 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:44.473322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:44.473926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:44.481404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:44.481844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:44.482599 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:44.483024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:44.616875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:44.624839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8dc2933b-c171-4dae-983b-8f7f864ccf6e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.155709 Jun 02 13:21:44.625416 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 97/237] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:44 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:44.966192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:44.966786 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:44.972857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:44.973297 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:44.974041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:44.974468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:45.114072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:45.121961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:45.123459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:45.124587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-02622bb6-d356-407a-83a7-96c557f9bf73 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1408 microversion: 2.20 time: 0.162268 Jun 02 13:21:45.125139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 141/238] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:44 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:21:45.641963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:45.642597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:45.649270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:45.649725 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:45.650489 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:45.651101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:45.798207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:45.806403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-68a2cff8-df95-440f-8189-9e2eb602df51 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.168456 Jun 02 13:21:45.807047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 98/239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:45 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:46.143295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:46.144004 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:46.150709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.151145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:46.151939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.152373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:46.284906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:46.292714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:46.294205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:46.295334 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f5ece520-0c5d-4bc2-9680-e71a12f367eb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1601 microversion: 2.20 time: 0.156033 Jun 02 13:21:46.295894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 142/240] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:21:46 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:21:46.313236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:46.313722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:46.320184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.320618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:46.321364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.321789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:46.400690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4c295bd3-bb9c-4e58-9712-14ea5d145605 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091335 Jun 02 13:21:46.401282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 99/241] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Jun 2 13:21:46 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:21:46.826188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:46.826188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:46.829754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.830265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:46.831090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:46.831590 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:47.105481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:47.113045 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d5971d31-2bd7-4f18-8460-babd89def698 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.294316 Jun 02 13:21:47.113628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 143/242] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:46 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:47.817853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-5aa0b99f-8594-4a68-a82b-c1584d4bae18 req-f7b06aa8-ad75-45f3-994a-50674e2175b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:21:47.827696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5aa0b99f-8594-4a68-a82b-c1584d4bae18 req-f7b06aa8-ad75-45f3-994a-50674e2175b5 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:47.828392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5aa0b99f-8594-4a68-a82b-c1584d4bae18 req-f7b06aa8-ad75-45f3-994a-50674e2175b5 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:47.848083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-5aa0b99f-8594-4a68-a82b-c1584d4bae18 req-f7b06aa8-ad75-45f3-994a-50674e2175b5 service nova] Creating event network-changed:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:21:47.855549 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-5aa0b99f-8594-4a68-a82b-c1584d4bae18 req-f7b06aa8-ad75-45f3-994a-50674e2175b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041867 Jun 02 13:21:47.856556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 100/243] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:21:48.129921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:48.130684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:48.136714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:48.137159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:48.137925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:48.138349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:48.270803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:48.278880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dae8420d-9024-492a-9571-8b3b9dc7b957 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.152873 Jun 02 13:21:48.279451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 144/244] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:48 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:49.298013 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:49.298700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:49.305020 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:49.305465 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:49.306211 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:49.306646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:49.443681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:49.451283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-63e07a20-f566-4ca9-aa9b-2d1ad417e127 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.158058 Jun 02 13:21:49.451840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 101/245] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:49 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:50.468434 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:50.469030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:50.476345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:50.476719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:50.477503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:50.477944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:50.691535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:50.699071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c300a9b4-bae2-47e3-baad-eb93fa5c67dd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.234491 Jun 02 13:21:50.699642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 145/246] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:50 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:51.716767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:51.717375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:51.719826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=43 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:51.724952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:51.725385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:51.726127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:51.726550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:51.853202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:51.860965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e316aeb7-76e3-4e3c-ac51-a2d38656b1cf tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.147946 Jun 02 13:21:51.861583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 102/247] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:51 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:52.878487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:52.879090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:52.885806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:52.886251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:52.887103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:52.887544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:53.018265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:53.025593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d77a4150-2aaa-458c-a49b-ba9e8610f28f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.150996 Jun 02 13:21:53.026150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 146/248] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:52 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:54.042402 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:54.043007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:54.049461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:54.049895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:54.050639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:54.051067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:54.181474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:54.189096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4a93536b-65bc-436a-ac67-bad7778d0834 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.150427 Jun 02 13:21:54.189685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 103/249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:54 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:55.206022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:55.206637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:55.213479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:55.213927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:55.214694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:55.215126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:55.219070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:55.340949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:55.348442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25222407-70f5-47c4-bfbf-75773c0234aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.146459 Jun 02 13:21:55.349652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 147/250] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:55 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:56.366610 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:56.367326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:56.374427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:56.374874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:56.375665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:56.376161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:56.511129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:56.518537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-50ba3fd4-52eb-43c8-a067-6435f44d116f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.156432 Jun 02 13:21:56.519103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 104/251] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:56 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:57.535533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:57.536465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:57.542267 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:57.542655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:57.543406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:57.543908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:57.675382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:57.682869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8d5f6c08-d644-4796-9dbb-cdef086446d8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.151266 Jun 02 13:21:57.683431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 148/252] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:57 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:58.699913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:58.700447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:58.706943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:58.707381 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:58.708194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:58.708628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:58.848236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:21:58.856902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f489606b-ff7a-4051-b068-c9335ec185a1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.160916 Jun 02 13:21:58.857706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 105/253] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:58 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:21:59.874041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:21:59.874648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:21:59.881483 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:59.881927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:21:59.882695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:21:59.883131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:00.015219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:00.023294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c3a3e6b2-38e1-4670-b089-5e5e6e1b35d6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1522 microversion: 2.1 time: 0.153104 Jun 02 13:22:00.023859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 149/254] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:21:59 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:01.040812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:01.041551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:01.048337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:01.051526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:01.051526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:01.051526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:01.181806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:01.190692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dd4ea8f6-909c-4cf7-b7f8-1c8bdce8e55a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1502 microversion: 2.1 time: 0.154265 Jun 02 13:22:01.191272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 106/255] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:01 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:01.206613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:01.207226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:01.215293 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:01.215743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:01.216551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:01.216983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:01.355664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:01.363357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2a781b5c-1fac-4d0d-9f61-e9067bd74a8e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1516 microversion: 2.1 time: 0.160616 Jun 02 13:22:01.363954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 150/256] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:01 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:04.389297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:04.390383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:04.397849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:04.399382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:04.400165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:04.400165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:04.423713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'flavor' on Instance uuid 5d47700d-bd87-46b1-baae-0c9fb526d72b {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:22:04.772627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d4e12683-85ff-4589-9d1f-8d789b280cf1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/action" status: 200 len: 32 microversion: 2.1 time: 0.387185 Jun 02 13:22:04.773243 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 107/257] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:22:04 2022] POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:22:04.782418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:04.783612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:04.790559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:04.791009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:04.791775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:04.792253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:04.935392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:04.943699 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7748cf56-32c0-4f72-939d-db150a578455 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.164593 Jun 02 13:22:04.944307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 151/258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:04 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:05.961895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:05.962579 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:05.970121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:05.970564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:05.971320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:05.971782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:06.098598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:06.105941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6b4de3d3-6b3b-41ba-ba37-54a9d45f0dad tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.149056 Jun 02 13:22:06.106503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 108/259] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:05 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:07.122767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:07.123301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:07.129283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:07.129726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:07.130480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:07.130915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:07.255948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:07.263336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e4fe4f8-0b05-484d-a852-68987067aa1c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.144569 Jun 02 13:22:07.263915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 152/260] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:07 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:08.280191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:08.280712 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:08.287236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:08.287674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:08.288462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:08.289414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:08.425143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:08.433325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ee84d7dc-df81-4da8-b98f-d9e01e88e6a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.157077 Jun 02 13:22:08.433914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 109/261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:08 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:09.452972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:09.453578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:09.455527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=36 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:09.461103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:09.461391 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:09.462151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:09.462599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:09.592664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:09.604640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b80b7802-c61f-4982-8646-c8977b605409 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.155518 Jun 02 13:22:09.605350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 153/262] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:09 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:10.622301 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:10.622987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:10.632066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:10.632066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:10.632066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:10.632066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:10.776508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:10.784497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b22bae9e-013d-413a-b608-335fe0fea1a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.166600 Jun 02 13:22:10.785071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 110/263] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:10 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:11.682151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:11.682671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:11.689337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:11.689874 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:11.690706 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:11.691137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:11.718961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:22:11.801506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:11.802103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:11.809058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:11.809630 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:11.810400 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:11.810832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:11.949588 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:11.970111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-af710de7-c07e-4e8e-a55d-408e3f704e6d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.172409 Jun 02 13:22:11.973957 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 111/264] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:11 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:12.116314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-840af5e6-fd97-431f-9fc1-99be19dcd19b tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 204 len: 0 microversion: 2.1 time: 0.437934 Jun 02 13:22:12.116908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 154/265] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:22:11 2022] DELETE /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:12.132378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:12.132981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:12.140041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:12.140483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:12.141235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:12.141662 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:12.160398 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:12.286035 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:12.294340 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3485647c-3d13-4ac8-983d-4a6dc067c1f1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.165882 Jun 02 13:22:12.294929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 112/266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:12 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:12.990910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:12.991603 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:12.998083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:12.998540 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:12.999323 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:12.999924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:13.150380 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:13.170289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-794e16d4-588e-44d2-92c9-2865cbc01e11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.183578 Jun 02 13:22:13.172271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 155/267] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:12 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:13.310409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:13.311015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:13.318294 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:13.318738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:13.319500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:13.319968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:13.452668 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:13.461569 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5b3c4320-2608-416a-a803-6612f71cbeb5 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.154977 Jun 02 13:22:13.462185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 113/268] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:13 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:14.190047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:14.190047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:14.196364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:14.196868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:14.197620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:14.198052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:14.369252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:14.377924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5664b54c-ba6f-4277-b1a9-d65b3c3d498b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.193602 Jun 02 13:22:14.379192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 156/269] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:14 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:14.479375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:14.479987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:14.488046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:14.488517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:14.489447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:14.490028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:14.645415 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:14.668588 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1fdb36db-4d2d-4d80-a23a-0ce3426683e8 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.193757 Jun 02 13:22:14.669541 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 114/270] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:14 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:15.394887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:15.395863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:15.404687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:15.405276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:15.406136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:15.406629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:15.560620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:15.576970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aeef0c05-e0a2-45ca-83c8-31d581f5c50c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.184173 Jun 02 13:22:15.578718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 157/271] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:15 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:15.685645 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:15.686264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:15.693401 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:15.693850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:15.694622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:15.695059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:15.871176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:15.886980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-03a40148-e528-4d4d-92dd-c91cff2adeb1 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.205609 Jun 02 13:22:15.905490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 115/272] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:15 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:16.597652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:16.598254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:16.604283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:16.604730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:16.605495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:16.605929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:16.732300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:16.742063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f886101-d1da-4bd6-9d06-09cd05434762 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.147758 Jun 02 13:22:16.743105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 158/273] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:16 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:16.915547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:16.915547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:16.919230 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:16.919675 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:16.920515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:16.920952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:17.053827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:17.062683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-94f74b2c-e18a-49c1-be28-518b80f0e200 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.154812 Jun 02 13:22:17.063364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 116/274] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:16 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:17.764085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:17.765021 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:17.772256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:17.772866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:17.773662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:17.774136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:17.909662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:17.917839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-569ae140-e583-49ec-a177-3254df2700a9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.158626 Jun 02 13:22:17.918411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 159/275] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:17 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:18.079219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:18.079853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:18.086924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:18.098794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:18.098794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:18.098794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:18.224623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:18.232975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-71df5273-2b22-4f90-9177-5943a98191e2 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.157616 Jun 02 13:22:18.233574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 117/276] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:18 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:18.934718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:18.937618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:18.941572 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:18.942023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:18.942903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:18.943379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.148912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-604705365", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:19.190551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:19.198089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a77f92ec-a245-4322-8fc2-074ec23b74fb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.267387 Jun 02 13:22:19.198661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 160/277] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:18 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:19.203466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] validate_networks() for None {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:22:19.263187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:19.264254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:19.270846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:19.271419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.272852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:19.273419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.450587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:19.458928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a03300f6-3751-4b18-99e8-646e419a8f75 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1552 microversion: 2.1 time: 0.200941 Jun 02 13:22:19.464172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 161/278] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:19 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:19.487586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:22:19.488034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:22:19.491933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:22:19.491933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:22:19.491933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:22:19.499107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:19.499519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.500344 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:19.500776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.519044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Getting quotas for project 31fa1be11da94b1bb60d35198bdecf3b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:22:19.523055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Getting quotas for user fb52d81f382247cbb63e6c78d5196ae7 and project 31fa1be11da94b1bb60d35198bdecf3b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:22:19.534831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:22:19.537158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:22:19.561627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7050ae0e-ca38-4a60-986a-931a9e2ebae0 req-43a50f41-3364-4fb9-a8c5-0d7505cdd0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f653ea90-3377-4409-aefc-bd9db30f1841", "name": "network-vif-deleted", "tag": "5294a6c8-3267-40ee-b768-877080b87580"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:19.570191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7050ae0e-ca38-4a60-986a-931a9e2ebae0 req-43a50f41-3364-4fb9-a8c5-0d7505cdd0d7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:19.570624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7050ae0e-ca38-4a60-986a-931a9e2ebae0 req-43a50f41-3364-4fb9-a8c5-0d7505cdd0d7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:19.575052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.581952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7050ae0e-ca38-4a60-986a-931a9e2ebae0 req-43a50f41-3364-4fb9-a8c5-0d7505cdd0d7 service nova] Creating event network-vif-deleted:5294a6c8-3267-40ee-b768-877080b87580 for instance f653ea90-3377-4409-aefc-bd9db30f1841 on hv-cinder-79760 Jun 02 13:22:19.589004 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7050ae0e-ca38-4a60-986a-931a9e2ebae0 req-43a50f41-3364-4fb9-a8c5-0d7505cdd0d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030407 Jun 02 13:22:19.589596 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 162/279] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:19.695627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-08677372-c9dc-4b00-bec0-68c2c34e9eca tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562234 Jun 02 13:22:19.696308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 118/280] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:22:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:22:19.707756 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-476acc6b-17d6-4088-92bd-49ef6151b60e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:19.708582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-476acc6b-17d6-4088-92bd-49ef6151b60e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:19.762103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-476acc6b-17d6-4088-92bd-49ef6151b60e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:19.768835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-476acc6b-17d6-4088-92bd-49ef6151b60e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1214 microversion: 2.1 time: 0.065675 Jun 02 13:22:19.769410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 163/281] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:19 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:20.216687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:20.217236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:20.225900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.226346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.227109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.227545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.365196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:20.373368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-874b11ef-f64c-4653-9627-6041388fe586 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.161171 Jun 02 13:22:20.373930 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 119/282] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:20 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:20.479225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:20.479225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:20.485908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.486346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.487102 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.487572 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.551533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:20.558738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ab035d43-4ec8-45b6-8559-a02dc8916d95 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1510 microversion: 2.1 time: 0.085610 Jun 02 13:22:20.559295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 164/283] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:20 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:20.788317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:20.789441 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:20.800359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.800980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.801746 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:20.802173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:20.866564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:20.875227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e66e9ced-f06a-4302-bb06-1697c92edc1c tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1218 microversion: 2.1 time: 0.092908 Jun 02 13:22:20.875461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 120/284] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:20 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:21.390699 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:21.391311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:21.398547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.398547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.399003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.399436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.533997 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:21.541553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3eea4ac3-8633-4be4-8e8a-9bb76522646e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.155138 Jun 02 13:22:21.542124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 165/285] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:21 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:21.575853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:21.576482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:21.583096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.583542 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.584327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.584852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.647484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:21.659063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d2d325e2-5603-4308-9ead-fd1eedb05eaf tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1346 microversion: 2.1 time: 0.087547 Jun 02 13:22:21.659650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 121/286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:21 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:21.892213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:21.892861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:21.900268 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.900910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.901850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:21.902598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:21.969367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:21.977165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-81a64f59-83b2-498a-a8a9-7f85bc876d65 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1218 microversion: 2.1 time: 0.089053 Jun 02 13:22:21.977730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 166/287] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:21 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:22.559193 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:22.559892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:22.561857 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:22.566735 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:22.567167 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:22.567947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:22.568375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:22.675635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:22.676222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:22.682414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:22.683014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:22.683852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:22.684319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:22.701592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:22.710067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8fc492b9-ad3b-462b-ae2d-f4766d448eba tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.155453 Jun 02 13:22:22.710671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 122/288] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:22 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:22.747184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:22.755247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-45540621-4cef-4f3a-a5ea-677957e6abb9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1346 microversion: 2.1 time: 0.083617 Jun 02 13:22:22.755818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 167/289] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:22 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:22.994179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:22.994696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:23.001498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.001939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.002687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.003109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.062396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:23.069779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-662d13d8-d95d-4d8e-9c36-a5fabe0810ac tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1218 microversion: 2.1 time: 0.079610 Jun 02 13:22:23.070352 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 123/290] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:22 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:23.728411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:23.729019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:23.735734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.736202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.736953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.737374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.771938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:23.773766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:23.779609 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.780082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.780859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:23.781286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:23.887224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:23.895753 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1d7726df-a62d-46d8-bbd5-c2750ab3242f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.171900 Jun 02 13:22:23.896726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 168/291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:23 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:24.063488 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:24.071521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc4d4895-7894-4c38-b548-7bc42d9fb04e tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1346 microversion: 2.1 time: 0.303478 Jun 02 13:22:24.072124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 124/292] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:23 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1346 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:24.087047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:24.088620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:24.096801 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:24.097329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:24.098115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:24.098546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:24.173173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:24.182571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8fa09da0-b593-4f0e-8a88-15f8802f3439 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1218 microversion: 2.1 time: 0.099342 Jun 02 13:22:24.182990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 169/293] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:24 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:24.913393 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:24.913927 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:24.921152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:24.921592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:24.922345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:24.922773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:25.060927 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:25.068525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b31fc01d-a123-421e-b7fd-e0f7d262f52e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.159017 Jun 02 13:22:25.069124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 125/294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:24 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:25.089518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:25.090743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:25.096902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:25.097347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:25.098167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:25.098592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:25.159972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:25.168861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ca1a5759-a4ab-4db3-a147-bfea92b942b3 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1346 microversion: 2.1 time: 0.084179 Jun 02 13:22:25.169359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 170/295] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:25 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:25.198839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:25.199438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:25.209991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:25.210781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:25.212114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:25.212692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:25.281255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:25.288986 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5c566dbb-1914-40b4-9b10-8173ca2a89d0 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1266 microversion: 2.1 time: 0.094161 Jun 02 13:22:25.289575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 126/296] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:25 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:26.090226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:26.091392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:26.098218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.109403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.109403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.109403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.186865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:26.187500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:26.194089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.194540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.195308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.195741 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.264003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:26.272091 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:26.276070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8c3427c3-61f4-4d11-86d5-4e1f811d48e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.194234 Jun 02 13:22:26.278279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 171/297] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:26 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:26.291248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a071f896-82b0-4252-b286-6e6443e33b19 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1346 microversion: 2.1 time: 0.108272 Jun 02 13:22:26.293229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 127/298] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:26 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:26.306041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:26.306642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:26.313775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.314220 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.315011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:26.315442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:26.381880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:26.390658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aa462cf1-83f2-47b4-87f6-a3b8df2f3128 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1274 microversion: 2.1 time: 0.088660 Jun 02 13:22:26.391104 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 172/299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:26 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:27.295300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:27.296274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:27.306491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.306491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.306491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.306491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.310867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:27.315529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:27.321806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.322150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.322908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.323466 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.356638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.357079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.357520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lazy-loading 'fault' on Instance uuid f653ea90-3377-4409-aefc-bd9db30f1841 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:22:27.446412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:27.455480 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-39c8add0-816f-4244-ad7a-5bfa755d273c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.164652 Jun 02 13:22:27.456392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 128/300] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:27 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:27.461518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:27.462132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:27.469348 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.470077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.470867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:27.471303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:27.549176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:27.552708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:27.557537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a362a9cc-fb77-4b89-bff7-553aa4398466 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1284 microversion: 2.1 time: 0.099965 Jun 02 13:22:27.558685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 129/301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:27 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:27.645459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:27.653629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-57cf28eb-1783-45ef-aca5-c5aadb92d9be tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1351 microversion: 2.1 time: 0.348271 Jun 02 13:22:27.654199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 173/302] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:27 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1351 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:28.473088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:28.473698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:28.481420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.481872 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.484343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.484343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.576670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:28.578292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:28.585193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.586880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.587627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.588242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.655596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:28.655596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-26a00462-50fe-4efc-b547-85623abdb4a7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.185682 Jun 02 13:22:28.655596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 130/303] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:28 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:28.670871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:28.671789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:28.678623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.679158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.679986 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.680422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.717093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:28.717934 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:28.718391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lazy-loading 'fault' on Instance uuid f653ea90-3377-4409-aefc-bd9db30f1841 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:22:28.777669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc1e634407749c7a64fd2c10f9a8347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ef26a34e4e35a343427df4a8f0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:28.780755 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ddf1afbb-851b-462f-a903-ce782fd311bb tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 200 len: 1351 microversion: 2.1 time: 0.114233 Jun 02 13:22:28.781342 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 131/304] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:28 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:28.802226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:28.811981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2ec2a2c6-10bd-4b8e-ae1d-87ff29606edf tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.239055 Jun 02 13:22:28.811981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 174/305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:28 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:29.677597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:29.678205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:29.682130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.684598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.704863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.705517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.706474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.706944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.797913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:29.799084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:29.802414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.809655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.809655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.809655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.809655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.850601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] HTTP exception thrown: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Request method failure captured: Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 HTTP/1.1 Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkNnjCpaTU8b9ItLPS75uGnU4IGL1jVSeGELIPii7tMi4GXsDpb-lCghges_fOgLmviNREXpUKNtOjDP2BCrtQz8Sx27BKB55lMmFtIY7EjNbDNB3Rs1TKCF-zPEjzID4TvSM3LWd3-NxXJoa9oabGu0w7RoFpuEaXvnk2Pa2v-iqY Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:22:29.856986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7aa4ef26a34e4e35a343427df4a8f0ef"}]}] Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: ecc1e634407749c7a64fd2c10f9a8347 Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:29.858424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'f653ea90-3377-4409-aefc-bd9db30f1841'} Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:29.859233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:29.860917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:29.862035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Returning 404 to user: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:29.862035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2660e691-f25a-4622-a8a0-907fda97846f tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 404 len: 111 microversion: 2.1 time: 0.064814 Jun 02 13:22:29.862035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 175/306] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:29 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:22:29.862258 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:29.865286 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:29.865897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:29.872717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.873173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.873960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.874393 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.882503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e8ae03fd-ac0e-418a-a956-9617ff9831d1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1502 microversion: 2.1 time: 0.211538 Jun 02 13:22:29.883387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 132/307] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:29 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:29.889400 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f26732d2-7590-49c0-98c7-a6a8e1b548da req-6aebe491-95f3-4345-bea5-f62afea3503a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1", "tag": "24138ab4-c31d-4fa7-8112-9631b14d1d9c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:29.899513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f26732d2-7590-49c0-98c7-a6a8e1b548da req-6aebe491-95f3-4345-bea5-f62afea3503a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.900481 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f26732d2-7590-49c0-98c7-a6a8e1b548da req-6aebe491-95f3-4345-bea5-f62afea3503a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.924574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f26732d2-7590-49c0-98c7-a6a8e1b548da req-6aebe491-95f3-4345-bea5-f62afea3503a service nova] Creating event network-changed:24138ab4-c31d-4fa7-8112-9631b14d1d9c for instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 on hv-cinder-79760 Jun 02 13:22:29.931612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f26732d2-7590-49c0-98c7-a6a8e1b548da req-6aebe491-95f3-4345-bea5-f62afea3503a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046587 Jun 02 13:22:29.936250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 133/308] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:29.943075 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5996e8b0-04db-4100-bf66-c8c6c004e3f5"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:29.944739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:29.954924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.972052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:29.972052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:29.972052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.018978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] HTTP exception thrown: Cannot 'attach_volume' instance 5d47700d-bd87-46b1-baae-0c9fb526d72b while it is in vm_state rescued Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Request method failure captured: Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/os-volume_attachments HTTP/1.1 Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 74 Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkdoxQVsuRZyzeHL_NlpXhpxZTD16y94iYBpr4-Q4P-xoqoLcyjW0sf7KYmP81SO4hbITem5KItlLKF-dygpP6_kgVyU-NQoIv4pryREPefVHvFt4_AD17v51nmVfGNYCqvPyZpow125_D5S6A4h2sy3VPEf8wgHsaWJE2oimQ-ZpU Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:22:30.023486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dd922c0d796647f8891bf4c5671e4c7b"}]}] Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 5c3f539d6d374fd8b3eaa9e3e22e5cb1 Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {"volumeAttachment": {"volumeId": "5996e8b0-04db-4100-bf66-c8c6c004e3f5"}} Jun 02 13:22:30.029397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Cannot 'attach_volume' instance 5d47700d-bd87-46b1-baae-0c9fb526d72b while it is in vm_state rescued Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'server_id': '5d47700d-bd87-46b1-baae-0c9fb526d72b', 'body': {'volumeAttachment': {'volumeId': '5996e8b0-04db-4100-bf66-c8c6c004e3f5'}}} Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:30.030240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5d47700d-bd87-46b1-baae-0c9fb526d72b while it is in vm_state rescued Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:30.031479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5d47700d-bd87-46b1-baae-0c9fb526d72b while it is in vm_state rescued Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Returning 409 to user: Cannot 'attach_volume' instance 5d47700d-bd87-46b1-baae-0c9fb526d72b while it is in vm_state rescued {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fff6b77e-8563-40dd-965a-b64d747ac123 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088295 Jun 02 13:22:30.032677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 134/309] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:22:29 2022] POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 13:22:30.044425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:30.044425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:30.044425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.044425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.045001 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.045001 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.158440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:30.167208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-698f53d1-1dd5-47a7-87ab-3447ac02ef4f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.306988 Jun 02 13:22:30.177330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 176/310] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:29 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:30.177974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:30.179143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:30.188278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.188729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.189808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.191934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.207322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] HTTP exception thrown: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Request method failure captured: Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841/os-volume_attachments HTTP/1.1 Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkNnjCpaTU8b9ItLPS75uGnU4IGL1jVSeGELIPii7tMi4GXsDpb-lCghges_fOgLmviNREXpUKNtOjDP2BCrtQz8Sx27BKB55lMmFtIY7EjNbDNB3Rs1TKCF-zPEjzID4TvSM3LWd3-NxXJoa9oabGu0w7RoFpuEaXvnk2Pa2v-iqY Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:22:30.208917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7aa4ef26a34e4e35a343427df4a8f0ef"}]}] Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: ecc1e634407749c7a64fd2c10f9a8347 Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:30.210151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'server_id': 'f653ea90-3377-4409-aefc-bd9db30f1841'} Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:30.210798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:30.212211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:30.213272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Returning 404 to user: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:30.213272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3dd05d02-afb1-4223-8f29-94ddddb99ace tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040841 Jun 02 13:22:30.213272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 177/311] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:22:30 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:22:30.369292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b86985f-55cc-4fff-b90d-f6ce96348760 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/action" status: 202 len: 0 microversion: 2.1 time: 0.337685 Jun 02 13:22:30.371196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 135/312] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:22:30 2022] POST /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:22:30.390534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:30.391180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:30.409052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.409052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.409052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:30.409052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:30.618114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:30.633891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1db6c6d4-8c73-48c2-9caa-7e648364bc11 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.255738 Jun 02 13:22:30.641082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 178/313] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:30 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:31.185882 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:31.186726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:31.193580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.194073 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.194892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.195463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.366982 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:31.377308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a63b1485-cda1-4517-81e0-07baaecc0447 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.196794 Jun 02 13:22:31.386311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 136/314] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:31 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:31.663947 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:31.663947 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:31.670512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.670969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.671748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.672231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.727781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:31.728506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:31.739101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.739555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.740369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.740792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.765669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] HTTP exception thrown: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Request method failure captured: Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 HTTP/1.1 Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkNnjCpaTU8b9ItLPS75uGnU4IGL1jVSeGELIPii7tMi4GXsDpb-lCghges_fOgLmviNREXpUKNtOjDP2BCrtQz8Sx27BKB55lMmFtIY7EjNbDNB3Rs1TKCF-zPEjzID4TvSM3LWd3-NxXJoa9oabGu0w7RoFpuEaXvnk2Pa2v-iqY Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:22:31.768332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7aa4ef26a34e4e35a343427df4a8f0ef"}]}] Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: ecc1e634407749c7a64fd2c10f9a8347 Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.769690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'f653ea90-3377-4409-aefc-bd9db30f1841'} Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:31.774090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.775473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.777601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Returning 404 to user: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:31.777601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dc7a0881-d27c-442e-a9df-8a2f7cbc2160 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 404 len: 111 microversion: 2.1 time: 0.046959 Jun 02 13:22:31.777601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 137/315] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:22:31 2022] DELETE /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:22:31.783128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:31.783806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] [instance: f653ea90-3377-4409-aefc-bd9db30f1841] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:31.790760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.791199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.792053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:31.793123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:31.808684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] HTTP exception thrown: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Request method failure captured: Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 HTTP/1.1 Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkNnjCpaTU8b9ItLPS75uGnU4IGL1jVSeGELIPii7tMi4GXsDpb-lCghges_fOgLmviNREXpUKNtOjDP2BCrtQz8Sx27BKB55lMmFtIY7EjNbDNB3Rs1TKCF-zPEjzID4TvSM3LWd3-NxXJoa9oabGu0w7RoFpuEaXvnk2Pa2v-iqY Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:22:31.809869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7aa4ef26a34e4e35a343427df4a8f0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7aa4ef26a34e4e35a343427df4a8f0ef"}]}] Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7aa4ef26a34e4e35a343427df4a8f0ef Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-DeleteServersTestJSON-617008612 Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: ecc1e634407749c7a64fd2c10f9a8347 Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-DeleteServersTestJSON-617008612-project Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.811272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'f653ea90-3377-4409-aefc-bd9db30f1841'} Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:31.815896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. Jun 02 13:22:31.817859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:22:31.818904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] Returning 404 to user: Instance f653ea90-3377-4409-aefc-bd9db30f1841 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:31.818904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5765986b-52b6-4d8f-8742-9ca3d036faa9 tempest-DeleteServersTestJSON-617008612 tempest-DeleteServersTestJSON-617008612-project] 10.222.0.46 "GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841" status: 404 len: 111 microversion: 2.1 time: 0.036157 Jun 02 13:22:31.818904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 138/316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:31 2022] GET /compute/v2.1/servers/f653ea90-3377-4409-aefc-bd9db30f1841 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:22:31.834337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:31.843032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ae35f09-4fb3-43a9-a93c-da5e1276bed3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.185924 Jun 02 13:22:31.843603 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 179/317] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:31 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:32.395024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:32.396865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:32.410501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:32.414026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:32.414026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:32.415219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:32.679261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:32.692321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1182b43c-450c-43fb-b9c2-10a642d023a5 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.301554 Jun 02 13:22:32.692994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 139/318] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:32 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:32.860636 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:32.861236 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:32.867790 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:32.868264 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:32.869027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:32.869455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:33.006076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:33.015089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cde80d30-0156-4d15-880b-7a0d7cbbb2a2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.158350 Jun 02 13:22:33.018961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 180/319] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:32 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:33.711865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:33.712526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:33.719661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:33.720157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:33.720921 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:33.721357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:33.857376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:33.865308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6945019c-cd92-4a5d-b37e-c8ce75d4dd4e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.159148 Jun 02 13:22:33.865892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 140/320] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:33 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:34.035730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:34.038900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:34.046639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:34.055628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:34.058560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:34.059009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:34.083432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.213721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:34.223504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3c676d94-740d-4633-9f0a-9d0884123039 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.194244 Jun 02 13:22:34.224159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 181/321] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:34 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:34.882933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:34.883540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:34.891674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:34.892474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:34.893598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:34.894119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:35.095746 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:35.113006 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f56c2d8f-46c9-4cb8-95a8-50dd2b422205 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.233916 Jun 02 13:22:35.114026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 141/322] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:34 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:35.244046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:35.245241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:35.255498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:35.255970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:35.256740 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:35.257217 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:35.461868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:35.471799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-789b8139-3cee-4d6c-abeb-b99c88be13f0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.232811 Jun 02 13:22:35.473182 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 182/323] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:35 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:36.134013 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:36.135318 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:36.144078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:36.144534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:36.145321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:36.145773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:36.355731 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:36.367990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a9769a86-8169-40d3-bc13-7abe52635a48 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.237639 Jun 02 13:22:36.368749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 142/324] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:36 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:36.491430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:36.492150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:36.501615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:36.501615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:36.501854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:36.502247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:36.651194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:36.658980 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d5551a2f-0f49-4c86-a699-a1fda5b1ffb2 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1510 microversion: 2.1 time: 0.172322 Jun 02 13:22:36.659553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 183/325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:36 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:37.388152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:37.388995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:37.401638 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:37.402666 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:37.403444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:37.403931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:37.545525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:37.558848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e15c4609-bb8c-4fed-b4ef-b31ede4afe36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.169794 Jun 02 13:22:37.558848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 143/326] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:37 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:37.650702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-392c6f9b-984c-4c40-bf26-841c12468cd4 req-48774a30-5f35-4484-9b34-5f52cec8a859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1", "name": "network-vif-plugged", "status": "completed", "tag": "24138ab4-c31d-4fa7-8112-9631b14d1d9c"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:37.659557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-392c6f9b-984c-4c40-bf26-841c12468cd4 req-48774a30-5f35-4484-9b34-5f52cec8a859 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:37.660038 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-392c6f9b-984c-4c40-bf26-841c12468cd4 req-48774a30-5f35-4484-9b34-5f52cec8a859 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:37.672202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-392c6f9b-984c-4c40-bf26-841c12468cd4 req-48774a30-5f35-4484-9b34-5f52cec8a859 service nova] Creating event network-vif-plugged:24138ab4-c31d-4fa7-8112-9631b14d1d9c for instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 on hv-cinder-79760 Jun 02 13:22:37.676544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:37.677156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:37.679114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-392c6f9b-984c-4c40-bf26-841c12468cd4 req-48774a30-5f35-4484-9b34-5f52cec8a859 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Jun 02 13:22:37.679114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 184/327] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:37.684206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:37.684634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:37.685392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:37.685818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:37.836530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:37.845909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-68f3819f-7b5f-4cae-b5db-94064de4433a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1516 microversion: 2.1 time: 0.173037 Jun 02 13:22:37.846410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 144/328] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:37 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:38.570827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:38.571493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:38.578678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:38.579142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:38.579934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:38.580372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:38.751639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:38.766389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8d7906d-9e23-48b6-9f52-cf9cb53167f7 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.199630 Jun 02 13:22:38.768520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 185/329] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:38 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:39.784836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:39.785442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:39.800951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:39.801716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:39.803463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:39.803836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:39.956572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:39.966115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e873f8f8-3f98-463b-a7df-00e65ac2a905 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1314 microversion: 2.1 time: 0.185367 Jun 02 13:22:39.966694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 145/330] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:39 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:40.834298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0ac3e4e6-cc80-419d-b8d8-4ed421f94103 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: .version_select at 0x7f5a73e1b700>, body: {"keypair": {"name": "tempest-keypair-814208614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApagV/9dsOJvY9oJwiGOQ6l8v3B8t39qmE3anuqcYm2Py2pnoxMc9XK5SLhv6J/Sikx/0Mwb3qRrU921wqo2lA5ApVnqLzw6E63BLSHdJkD2kMTl81Zq45yb6XonkoBug=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:40.839028 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.850547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-0ac3e4e6-cc80-419d-b8d8-4ed421f94103 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:22:40.854515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-0ac3e4e6-cc80-419d-b8d8-4ed421f94103 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for user 5c3f539d6d374fd8b3eaa9e3e22e5cb1 and project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:22:40.936237 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0ac3e4e6-cc80-419d-b8d8-4ed421f94103 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105681 Jun 02 13:22:40.936763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 186/331] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:22:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:40.982960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:40.983602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:40.990314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:40.990765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:40.991532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:40.992143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:41.180408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:41.188975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b8e4656a-f69c-4145-baf2-c71fd3535c72 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1464 microversion: 2.1 time: 0.208941 Jun 02 13:22:41.188975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 146/332] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:40 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:41.232207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:41.232704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:41.239405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:41.239844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:41.240651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:41.241082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:41.267745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:22:41.517508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8616eec4-2a53-4b13-8d8e-b52e571f2583 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 204 len: 0 microversion: 2.1 time: 0.288944 Jun 02 13:22:41.518088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 187/333] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:22:41 2022] DELETE /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:41.530290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:41.530897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:41.537254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:41.537698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:41.538536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:41.539907 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:41.558194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.682446 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:41.690413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-96f0cf5f-9426-414c-9bb3-2616713c394e tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1470 microversion: 2.1 time: 0.163973 Jun 02 13:22:41.690985 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 147/334] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:41 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:42.709289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:42.710607 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:42.717869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:42.718315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:42.719087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:42.719522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:42.912810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:42.921911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4db762e4-7bb4-4e26-8528-93cec114cd36 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1470 microversion: 2.1 time: 0.216842 Jun 02 13:22:42.922678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 188/335] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:42 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:43.465412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1231031284", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deba372e-ce1f-430d-9406-fbc12c395831"}], "security_groups": [{"name": "tempest-securitygroup--123190599"}], "key_name": "tempest-keypair-814208614", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:43.580851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] validate_networks() for [('deba372e-ce1f-430d-9406-fbc12c395831', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:22:43.942325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:43.943692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:43.950429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:43.951053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:43.952000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:43.952610 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:44.004072 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:22:44.004496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:22:44.004968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:22:44.005373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:22:44.005781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:22:44.015689 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:44.016167 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:44.016967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:44.017409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:44.035636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:22:44.039849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Getting quotas for user 5c3f539d6d374fd8b3eaa9e3e22e5cb1 and project dd922c0d796647f8891bf4c5671e4c7b. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:22:44.053900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:22:44.056307 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:22:44.093452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:44.101229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-51c2d687-014b-4258-8d3d-0c2ec3ed3d10 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1470 microversion: 2.1 time: 0.163463 Jun 02 13:22:44.101808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 189/336] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:43 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:44.210975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ca259efe-c964-4dc6-84bc-2d91a1d97e29 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.750123 Jun 02 13:22:44.211931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 148/337] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:22:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:22:44.223225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fe4e0949-bc22-4f29-a6a3-cd59ad4df5de tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:44.224168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fe4e0949-bc22-4f29-a6a3-cd59ad4df5de tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:44.282710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fe4e0949-bc22-4f29-a6a3-cd59ad4df5de tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:44.295783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fe4e0949-bc22-4f29-a6a3-cd59ad4df5de tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1245 microversion: 2.1 time: 0.076199 Jun 02 13:22:44.296450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 190/338] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:44 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:45.118953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:45.119486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:45.127110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:45.127581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:45.128454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:45.128958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:45.257587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:45.265157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9560f6ef-e1e5-4896-a295-a4f85000809f tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1470 microversion: 2.1 time: 0.150855 Jun 02 13:22:45.265753 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 149/339] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:45 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:45.313067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:45.313668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:45.320010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:45.320463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:45.321265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:45.321700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:45.390535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:45.398172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c6bce6a5-f62c-4f75-b3a9-c1e4855fdec6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1249 microversion: 2.1 time: 0.088837 Jun 02 13:22:45.399452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 191/340] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:45 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:46.282051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:46.283291 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:46.290053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:46.290504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:46.291273 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:46.291716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:46.420878 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:46.421521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:46.428161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:46.428611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:46.433713 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:46.433713 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:46.504143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:46.512049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bb552f72-80f9-457b-8878-19dfccf87a17 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1470 microversion: 2.1 time: 0.233727 Jun 02 13:22:46.512635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 150/341] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:46 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:46.539342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:46.550437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e91132b6-1937-4283-b82b-2b67b0db3dc8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1297 microversion: 2.1 time: 0.133906 Jun 02 13:22:46.551027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 192/342] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:46 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:47.529102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:47.529954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:47.536422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:47.536864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:47.537625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:47.538053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:47.572647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:47.574327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:47.584289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:47.584730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:47.585669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:47.586742 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:47.626239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:47.642682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3c58957c-e77d-4825-84fe-ca1f273ba0ee tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1428 microversion: 2.1 time: 0.117181 Jun 02 13:22:47.644073 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 151/343] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:47 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:47.745067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:47.756137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b27e6c6e-8423-4669-9480-1c079089308d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1303 microversion: 2.1 time: 0.190444 Jun 02 13:22:47.760892 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 193/344] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:47 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:47.835196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-56ca786b-cfc0-49e5-968c-b92a018bc954 req-d39fdbaa-b79c-4a1c-b3fa-cac99d934e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1", "name": "network-vif-deleted", "tag": "24138ab4-c31d-4fa7-8112-9631b14d1d9c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:47.847246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-56ca786b-cfc0-49e5-968c-b92a018bc954 req-d39fdbaa-b79c-4a1c-b3fa-cac99d934e0a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:47.847246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-56ca786b-cfc0-49e5-968c-b92a018bc954 req-d39fdbaa-b79c-4a1c-b3fa-cac99d934e0a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:47.858290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-56ca786b-cfc0-49e5-968c-b92a018bc954 req-d39fdbaa-b79c-4a1c-b3fa-cac99d934e0a service nova] Creating event network-vif-deleted:24138ab4-c31d-4fa7-8112-9631b14d1d9c for instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 on hv-cinder-79760 Jun 02 13:22:47.870206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-56ca786b-cfc0-49e5-968c-b92a018bc954 req-d39fdbaa-b79c-4a1c-b3fa-cac99d934e0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038682 Jun 02 13:22:47.872964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 152/345] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:48.661455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:48.662176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:48.669097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:48.670836 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:48.672757 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:48.673729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:48.717130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:48.717578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:48.718029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lazy-loading 'fault' on Instance uuid fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:22:48.761392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb52d81f382247cbb63e6c78d5196ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31fa1be11da94b1bb60d35198bdecf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:48.769982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0bada62d-0811-4623-933f-728a276edb00 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 200 len: 1304 microversion: 2.1 time: 0.113111 Jun 02 13:22:48.773201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 194/346] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:48 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:48.775119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:48.776094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:48.784402 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:48.784857 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:48.785634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:48.786077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:48.928895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:48.937334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aee0cdc9-ba85-442d-bf15-8e710b63ed7c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.166954 Jun 02 13:22:48.937919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 153/347] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:48 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:49.797204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:49.798626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] [instance: fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:49.810080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:49.812314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:49.812314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:49.812314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:49.837255 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] HTTP exception thrown: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Request method failure captured: Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 HTTP/1.1 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLmH5YiVB-nlXCuWm-FcZgTr_nJEbZ0ODTl2ZgKcLv2ZkGwbk2OCtikfRP6HrIT3GrovbvXzt2op5HUukwj9MdDusm-zZ8-Nckb_Vt2ui66nQZ9e4gG-pKLJd3y7VNlMXLxPlzpX3VDW-KP4iKD0z44gnA3mN9j0fgy3Pdv5hcGbKx4 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 31fa1be11da94b1bb60d35198bdecf3b Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-1215700745 Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:22:49.839468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31fa1be11da94b1bb60d35198bdecf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31fa1be11da94b1bb60d35198bdecf3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31fa1be11da94b1bb60d35198bdecf3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31fa1be11da94b1bb60d35198bdecf3b"}]}] Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-1215700745 Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 31fa1be11da94b1bb60d35198bdecf3b Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-1215700745 Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-1215700745-project Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: fb52d81f382247cbb63e6c78d5196ae7 Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-1215700745-project Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. Jun 02 13:22:49.841419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1'} Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:22:49.842188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. Jun 02 13:22:49.843840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:22:49.847840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] Returning 404 to user: Instance fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:22:49.847840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-575b60d1-1ccc-4b65-b06b-faa6c1446e04 tempest-VolumesNegativeTest-1215700745 tempest-VolumesNegativeTest-1215700745-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1" status: 404 len: 111 microversion: 2.1 time: 0.059223 Jun 02 13:22:49.847840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 195/348] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:49 2022] GET /compute/v2.1/servers/fa1fdb3f-0620-4ef9-89c6-2c0ff99c16a1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:22:49.900407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f2f98fb7-bb15-40ca-b4a6-fdf5d6f8b1e8 req-c15692cc-871f-4540-946b-94ad1c8de9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:49.910643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f2f98fb7-bb15-40ca-b4a6-fdf5d6f8b1e8 req-c15692cc-871f-4540-946b-94ad1c8de9fe service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:49.911108 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f2f98fb7-bb15-40ca-b4a6-fdf5d6f8b1e8 req-c15692cc-871f-4540-946b-94ad1c8de9fe service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:49.941818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f2f98fb7-bb15-40ca-b4a6-fdf5d6f8b1e8 req-c15692cc-871f-4540-946b-94ad1c8de9fe service nova] Creating event network-changed:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:22:49.962613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:49.964123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:49.969926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f2f98fb7-bb15-40ca-b4a6-fdf5d6f8b1e8 req-c15692cc-871f-4540-946b-94ad1c8de9fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067052 Jun 02 13:22:49.969926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 154/349] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:22:49.973494 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:49.974004 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:49.974785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:49.975214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:50.258417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:50.267657 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1cf5c434-7bb6-43da-827d-8d881f7cc7fa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.309790 Jun 02 13:22:50.277216 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 196/350] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:49 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:51.287563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:51.288405 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:51.296774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:51.297685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:51.298191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:51.298816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:51.526321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:51.537784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4701fdaa-31b4-4744-9e27-bc5928fb1bcb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.254856 Jun 02 13:22:51.549840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 155/351] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:51 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:52.556007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:52.556609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:52.563662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:52.564036 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:52.564798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:52.565231 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:52.713695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:52.724973 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5a90a046-20da-4952-a72d-7c97a97a3cdb tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.172796 Jun 02 13:22:52.725559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 197/352] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:52 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:53.748342 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:53.748342 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:53.753610 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.755693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:53.756185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:53.757171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:53.757758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:53.914365 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:53.925925 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-51896415-8b8c-4d54-96a3-e8611792156a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.185611 Jun 02 13:22:53.926601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 156/353] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:53 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:54.955473 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:54.956201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:54.960495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.969402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:54.969951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:54.971135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:54.971840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:55.165235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:55.173620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-717d261d-4b60-4299-add8-016f30236980 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.223266 Jun 02 13:22:55.174546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 198/354] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:54 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:56.192007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:56.192597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:56.194355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.195019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.207928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:56.207928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:56.207928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:56.207928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:56.226876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-fd3c044c-b407-43a8-adcd-11020fe85113 req-3c1d3662-0d6c-46f2-bfe5-6dbd5df5c883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "name": "network-vif-plugged", "status": "completed", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:22:56.255599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fd3c044c-b407-43a8-adcd-11020fe85113 req-3c1d3662-0d6c-46f2-bfe5-6dbd5df5c883 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:56.256221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fd3c044c-b407-43a8-adcd-11020fe85113 req-3c1d3662-0d6c-46f2-bfe5-6dbd5df5c883 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:56.274640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-fd3c044c-b407-43a8-adcd-11020fe85113 req-3c1d3662-0d6c-46f2-bfe5-6dbd5df5c883 service nova] Creating event network-vif-plugged:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:22:56.281458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-fd3c044c-b407-43a8-adcd-11020fe85113 req-3c1d3662-0d6c-46f2-bfe5-6dbd5df5c883 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058122 Jun 02 13:22:56.286598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 199/355] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:22:56.418546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:56.434521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6aa3bdcd-dc4b-4b37-86d2-87aeee30aa67 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.246108 Jun 02 13:22:56.435115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 157/356] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:56 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:57.453031 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:57.453724 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:57.460561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:57.461165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:57.462197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:57.462625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:57.468792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.612696 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:57.620307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7bb89c79-2b70-41f8-97d3-bd94609c740e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.172018 Jun 02 13:22:57.620897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 200/357] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:57 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:58.638452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:58.639039 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:58.647512 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:58.647983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:58.648747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:58.649175 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:58.827116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:22:58.835935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4c12e3f9-4fff-487b-915d-64087778cc12 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1370 microversion: 2.1 time: 0.201430 Jun 02 13:22:58.836491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 158/358] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:58 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:59.854583 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:22:59.856537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:22:59.869651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:59.872652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:22:59.877136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:22:59.877839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:00.052753 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:00.060970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ad19c21-ba58-4102-bde4-620ef3a6ca9f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1565 microversion: 2.1 time: 0.210879 Jun 02 13:23:00.061545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 201/359] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:22:59 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:00.077592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:00.078118 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:00.086192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:00.086912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:00.087805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:00.088270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:00.176765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-690fd5f5-759c-40d7-8361-db5a40b5e950 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103083 Jun 02 13:23:00.177420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 159/360] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:23:00 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:01.659948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-bf193b75-2ff2-4440-bca3-9e680fce56db req-d98d1667-97ea-47b6-b776-13b2f32e7c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:01.677990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bf193b75-2ff2-4440-bca3-9e680fce56db req-d98d1667-97ea-47b6-b776-13b2f32e7c4f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:01.678445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bf193b75-2ff2-4440-bca3-9e680fce56db req-d98d1667-97ea-47b6-b776-13b2f32e7c4f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:01.710575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-bf193b75-2ff2-4440-bca3-9e680fce56db req-d98d1667-97ea-47b6-b776-13b2f32e7c4f service nova] Creating event network-changed:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:23:01.718048 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-bf193b75-2ff2-4440-bca3-9e680fce56db req-d98d1667-97ea-47b6-b776-13b2f32e7c4f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065778 Jun 02 13:23:01.720011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 202/361] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:23.462808 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=7 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.463589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=60 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.467552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446107719", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "networks": [{"uuid": "7733cbbd-faa4-4f7a-ae06-7ebe69144a00"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:23.531021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] validate_networks() for [('7733cbbd-faa4-4f7a-ae06-7ebe69144a00', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:23:24.010448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:23:24.012694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:23:24.014902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:23:24.016248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:23:24.016844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:23:24.030590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:24.031732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:24.032919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:24.033704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:24.075153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Getting quotas for project d8e983852747461b8ca663cd6ff56ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:23:24.082864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Getting quotas for user 022e761cfc694697b0ef9886025abc5e and project d8e983852747461b8ca663cd6ff56ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:23:24.095388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:23:24.097959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:23:24.343068 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f0e33018-3c8b-43ae-a3ca-87261b7323fa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881699 Jun 02 13:23:24.345947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 160/362] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:23:24.356639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d3e5fa5f-46c9-4068-a817-425fddab5d84 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:24.362240 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d3e5fa5f-46c9-4068-a817-425fddab5d84 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:24.362415 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.363660 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=12 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.469141 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3e5fa5f-46c9-4068-a817-425fddab5d84 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:24.487555 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d3e5fa5f-46c9-4068-a817-425fddab5d84 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1213 microversion: 2.1 time: 0.135296 Jun 02 13:23:24.489709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 203/363] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:24 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:24.508934 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1182324174", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "networks": [{"uuid": "61c5a169-eacf-482c-a1b5-ec89c214a1aa"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:24.579942 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] validate_networks() for [('61c5a169-eacf-482c-a1b5-ec89c214a1aa', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:23:25.054014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:23:25.054721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:23:25.055362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:23:25.055993 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:23:25.056561 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:23:25.068363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:25.069043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:25.070562 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:25.071284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:25.096743 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Getting quotas for project 8522fa2a30e440b890516e350e17de14. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:23:25.101469 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Getting quotas for user 2113938dc6b94ec09e70771fdf570a85 and project 8522fa2a30e440b890516e350e17de14. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:23:25.119608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:23:25.122495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:23:25.303558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e299827c-fd4d-4635-b0d8-f8e651b981ec tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802004 Jun 02 13:23:25.304881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 161/364] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:23:25.315211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f6493fc-159e-454b-bd0a-affdfbb8f5ae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:25.315816 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f6493fc-159e-454b-bd0a-affdfbb8f5ae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:25.378869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f6493fc-159e-454b-bd0a-affdfbb8f5ae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:25.404348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f6493fc-159e-454b-bd0a-affdfbb8f5ae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1219 microversion: 2.1 time: 0.093425 Jun 02 13:23:25.406077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 204/365] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:25 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:25.506509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f249c2ca-a192-4227-a7cb-24bb85bb5b7f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:25.507127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f249c2ca-a192-4227-a7cb-24bb85bb5b7f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:25.625814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f249c2ca-a192-4227-a7cb-24bb85bb5b7f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:25.635673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f249c2ca-a192-4227-a7cb-24bb85bb5b7f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1213 microversion: 2.1 time: 0.132571 Jun 02 13:23:25.637436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 162/366] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:25 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:26.423270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6fd9dc0b-5aa6-449a-b27a-7462a279fdea tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:26.425166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6fd9dc0b-5aa6-449a-b27a-7462a279fdea tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:26.487389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6fd9dc0b-5aa6-449a-b27a-7462a279fdea tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:26.503077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6fd9dc0b-5aa6-449a-b27a-7462a279fdea tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1219 microversion: 2.1 time: 0.085249 Jun 02 13:23:26.507817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 205/367] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:26 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:26.658688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:26.658688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:26.667002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:26.667453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:26.669612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:26.669612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:26.761223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:26.772478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aa9c8da3-8453-4a64-9eab-c8648512949d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1265 microversion: 2.1 time: 0.119232 Jun 02 13:23:26.773254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 163/368] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:26 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:27.530336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:27.534028 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:27.564592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:27.565883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:27.573163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:27.574987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:27.676204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:27.695402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c2725239-4478-44cc-9eb0-3d07e8dc4cd1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1223 microversion: 2.1 time: 0.173105 Jun 02 13:23:27.705933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 206/369] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:27 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:27.789886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:27.791019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:27.799420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:27.800137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:27.801349 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:27.801961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:27.883573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:27.895118 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bdaab34c-764c-4444-b74c-d61022240b80 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1273 microversion: 2.1 time: 0.109459 Jun 02 13:23:27.896227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 164/370] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:27 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:28.714442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:28.715197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:28.721959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:28.722746 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:28.723774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:28.724341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:28.896606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:28.920890 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:28.921508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:28.945277 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e61d6f82-ea92-48d1-bdbf-f9c108803ceb tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1271 microversion: 2.1 time: 0.235528 Jun 02 13:23:28.949949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 207/371] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:28 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:28.957301 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:28.958129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:28.960626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:28.961079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:29.188371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:29.196203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-49838b09-aa7b-459a-af8e-217496fe77cb tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.286533 Jun 02 13:23:29.196788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 165/372] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:28 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:29.968279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:29.969133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:29.979446 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:29.980320 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:29.982223 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:29.982921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:30.141805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:30.149957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ad06806a-a702-4b83-a00d-95ebe042f8d7 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1277 microversion: 2.1 time: 0.187072 Jun 02 13:23:30.161647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 208/373] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:29 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:30.219315 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:30.229578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:30.237298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:30.237769 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:30.238532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:30.239139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:30.405980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:30.417975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-36f9e213-bdd1-470a-b6f2-9688b87674d6 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.207158 Jun 02 13:23:30.419290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 166/374] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:30 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:30.638199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-888f815c-9ede-49af-b29c-d9c77ed23cbf req-885db447-f1b1-4a6f-954b-6f2066f90056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d210210c-6ba3-4776-a622-19ed9a44668d", "tag": "7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:30.662489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-888f815c-9ede-49af-b29c-d9c77ed23cbf req-885db447-f1b1-4a6f-954b-6f2066f90056 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:30.669887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-888f815c-9ede-49af-b29c-d9c77ed23cbf req-885db447-f1b1-4a6f-954b-6f2066f90056 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:30.683026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-888f815c-9ede-49af-b29c-d9c77ed23cbf req-885db447-f1b1-4a6f-954b-6f2066f90056 service nova] Creating event network-changed:7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b for instance d210210c-6ba3-4776-a622-19ed9a44668d on hv-cinder-79760 Jun 02 13:23:30.699587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-888f815c-9ede-49af-b29c-d9c77ed23cbf req-885db447-f1b1-4a6f-954b-6f2066f90056 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073241 Jun 02 13:23:30.703440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 209/375] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:31.168316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:31.169747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:31.178705 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:31.180507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:31.181355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:31.182474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:31.328498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:31.337848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e3473a81-a729-4839-91ee-34e9beed2eb0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.173212 Jun 02 13:23:31.338874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 167/376] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:31 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:31.436340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:31.437395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:31.444550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:31.445136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:31.446381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:31.447116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:31.717384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:31.733750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05679caf-575e-4338-b23d-39322879cc73 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.301765 Jun 02 13:23:31.735057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 210/377] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:31 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:32.275124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'create', calling method: .version_select at 0x7f5a805fb820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-75463125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqMSA3p/w+Z3jus6oWja1Bd6znXf0JqrAzW6X2CseCd2+FeeLpaJRqMlFyNZttKzAXlDqpFMqkaXpL5azMKiJwf9Zgt3nGq9l6QgJM/Ur1Q1M4dOonr4t5abL68YyZpxQ=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:32.289460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Getting quotas for project 81684485980545cda977f1d7e72f90e2. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:23:32.293357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Getting quotas for user fac722ebafd540b0b3fe05d83fa39c36 and project 81684485980545cda977f1d7e72f90e2. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:23:32.307191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 13:23:32.355512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:32.356810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:32.363063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:32.363508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:32.364298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:32.364737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:32.499704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:32.507202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e0914b2b-e3ba-4c9d-8a94-5d6d0ccf5a68 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.155694 Jun 02 13:23:32.507769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 211/378] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:32 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:32.714471 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-99126b09-469c-48e7-bb96-9b2d346e56f8 req-48d09a9a-5430-4ea8-bb35-19f55c176906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e727ae-ed6d-4ffa-9ff6-15720b19cab8", "tag": "5ce65711-1669-4da7-af73-7be574b09260"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:32.723267 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-99126b09-469c-48e7-bb96-9b2d346e56f8 req-48d09a9a-5430-4ea8-bb35-19f55c176906 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:32.723709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-99126b09-469c-48e7-bb96-9b2d346e56f8 req-48d09a9a-5430-4ea8-bb35-19f55c176906 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:32.734764 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-99126b09-469c-48e7-bb96-9b2d346e56f8 req-48d09a9a-5430-4ea8-bb35-19f55c176906 service nova] Creating event network-changed:5ce65711-1669-4da7-af73-7be574b09260 for instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 on hv-cinder-79760 Jun 02 13:23:32.739557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-99126b09-469c-48e7-bb96-9b2d346e56f8 req-48d09a9a-5430-4ea8-bb35-19f55c176906 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029030 Jun 02 13:23:32.740196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 212/379] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:23:32.751385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:32.752142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:32.758558 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:32.759003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:32.759788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:32.760241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:32.893990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:32.901481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-68ef1362-77f0-45cc-a8b6-26572c32b9f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.154378 Jun 02 13:23:32.903542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 213/380] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:32 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:33.315252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 33666. Jun 02 13:23:33.433481 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-35fe7524-cdeb-42f1-98e1-0e0ee7d397ab tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.162267 Jun 02 13:23:33.434589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 168/381] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:23:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:33.524029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:33.524499 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:33.530764 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.531211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.532020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.532459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.535115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-130166360", "imageRef": "bbfe491b-a396-4e80-b9ef-1ab5a51506e9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-75463125", "networks": [{"uuid": "de2e0296-ffc7-484a-ac45-b4b0b2dd681c"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:33.585165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] validate_networks() for [('de2e0296-ffc7-484a-ac45-b4b0b2dd681c', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:23:33.664093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:33.672861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a3d96d17-a6f6-4840-bfa9-c04d1a3ebd0f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.153015 Jun 02 13:23:33.673432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 214/382] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:33 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:33.920514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:33.921648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:33.928174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.928863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.929792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.930387 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.958041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:23:33.958463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:23:33.958934 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:23:33.959341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:23:33.959749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:23:33.969376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.970082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.970917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:33.971360 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:33.988504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Getting quotas for project 81684485980545cda977f1d7e72f90e2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:23:33.992968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Getting quotas for user fac722ebafd540b0b3fe05d83fa39c36 and project 81684485980545cda977f1d7e72f90e2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:23:34.003767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:23:34.006065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbfe491b-a396-4e80-b9ef-1ab5a51506e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:23:34.058150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:34.065491 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-73a8a287-0e40-4e38-913f-bc5720660a5e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.149537 Jun 02 13:23:34.066050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 215/383] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:33 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:34.170462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e7fff839-c0d5-456b-89de-2fe526b757cf tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639331 Jun 02 13:23:34.171266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 169/384] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:23:34.180982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8e4f85dd-c39f-4a0d-b2d6-184bef18f880 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:34.181579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e4f85dd-c39f-4a0d-b2d6-184bef18f880 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:34.238099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e4f85dd-c39f-4a0d-b2d6-184bef18f880 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:34.244814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8e4f85dd-c39f-4a0d-b2d6-184bef18f880 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1256 microversion: 2.1 time: 0.067724 Jun 02 13:23:34.245384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 216/385] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:34 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1256 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:34.691665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:34.692282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:34.699061 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:34.699502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:34.708235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:34.708235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:34.831999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:34.839747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0dcfcfc8-223d-44ca-b465-705b07551a21 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.152343 Jun 02 13:23:34.841051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 170/386] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:34 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:35.082388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:35.082943 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:35.089952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.091035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.091936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.092373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.224083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:35.231999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31fc55c8-f267-4a68-81a1-1740dc80c8aa tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.153554 Jun 02 13:23:35.232569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 217/387] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:35 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:35.261683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:35.262832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:35.269037 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.269464 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.270226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.270657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.329947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:35.338150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0c5dba2d-0a46-419c-ba03-e1baa0d1044f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.080029 Jun 02 13:23:35.338487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 171/388] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:35 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:35.857602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:35.858203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:35.864390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.864829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.865579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:35.866007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:35.993427 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:36.001566 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c854be44-2de5-47da-be0f-7b531d57705c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.148353 Jun 02 13:23:36.002339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 218/389] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:35 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:36.248801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:36.249335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:36.256007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:36.256453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:36.257213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:36.270260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:36.356688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:36.357917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:36.365150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:36.365900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:36.366850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:36.367292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:36.390173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:36.398002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8e71b7a5-4603-4d34-9dfc-c2aaa1548744 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.153049 Jun 02 13:23:36.398580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 172/390] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:36 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:36.451614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:36.460844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d417da9d-ad02-4118-91e9-7ff197a376ef tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.109477 Jun 02 13:23:36.461570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 219/391] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:36 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:37.018507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:37.019113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:37.025138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.025582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.026335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.026767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.155284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:37.162923 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3c321d17-6e17-495f-af3e-2704ba5b40da tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.148190 Jun 02 13:23:37.163498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 173/392] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:37 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:37.414502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:37.415111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:37.421715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.422161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.422923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.423358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.478561 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:37.479179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:37.486581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.487221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.488223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:37.488826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:37.558640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:37.561733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:37.567239 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d3e3d1e7-a85f-467d-8fd1-f11f43e72e38 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.156525 Jun 02 13:23:37.567903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 220/393] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:37 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:37.573663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc0a8c2d-0a2b-40d4-8dfd-79bc99073f66 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.094677 Jun 02 13:23:37.573663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 174/394] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:37 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:38.179769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:38.180408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:38.186565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.187010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.187821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.188289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.316893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:38.324298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-164575ba-ca50-4772-b93b-8715dfd4d3f2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.148457 Jun 02 13:23:38.325363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 221/395] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:38 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:38.583422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:38.584066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:38.585976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:38.586651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:38.590668 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.591114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.591890 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.592325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.593121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.593565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.594321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:38.594758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:38.657798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:38.665480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5117be63-cb17-48ce-8080-6535d88d4a8b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.083419 Jun 02 13:23:38.666050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 222/396] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:38 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:38.721254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:38.728657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1c1befe9-eeaf-4871-a6db-e3eed3259a2b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.149071 Jun 02 13:23:38.729223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 175/397] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:38 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:39.343096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:39.343708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:39.350127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.350604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.351396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.351830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.480798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:39.488137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-04a55717-0e10-4a94-ab59-c459994ee020 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.149585 Jun 02 13:23:39.488700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 223/398] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:39 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:39.682028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:39.682650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:39.689798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.690234 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.690974 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.691399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.746430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:39.747818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:39.752671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:39.754697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.755456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.756770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:39.757502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:39.764627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bdb436d4-866f-47d2-8c0e-d1122b66dd9d tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.086031 Jun 02 13:23:39.765684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 176/399] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:39 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:39.888401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:39.891961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.896251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-06c8b614-64e7-4b26-8d2c-a0bceb8001f2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.153742 Jun 02 13:23:39.896825 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 224/400] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:39 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:40.505768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:40.506371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:40.512930 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.513367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:40.514109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.514536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:40.642309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:40.650443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6c217cfa-6c7e-4f6c-9480-4ba3130ebe2d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.148370 Jun 02 13:23:40.650958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 177/401] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:40 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:40.782825 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:40.783429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:40.789963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.790412 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:40.791162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.791597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:40.853912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:40.861255 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-565f0c63-4ca8-4a54-a976-075a42f9c18e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.082333 Jun 02 13:23:40.861811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 225/402] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:40 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:40.920764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:40.921395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:40.927720 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.928200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:40.928961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:40.929403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:41.055629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:41.063632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6bbb1898-2265-4e99-8d31-dcc317e1eac9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.146782 Jun 02 13:23:41.064233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 178/403] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:40 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:41.667315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:41.667994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:41.675106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:41.675549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:41.680167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:41.680167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:41.812828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:41.820333 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-32391de6-de0c-4b49-bd92-e1ec42b7bd1f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.157047 Jun 02 13:23:41.820904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 226/404] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:41 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:41.878063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:41.878786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:41.885149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:41.885659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:41.886429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:41.886863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:41.950219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:41.957626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-24b32fb5-91ce-461c-ba1f-c339439e9d59 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.083488 Jun 02 13:23:41.958205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 179/405] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:41 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:42.080798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:42.081478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:42.087853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.088338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:42.089102 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.089542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:42.217581 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:42.225250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-49f2e976-b0e6-43df-87be-2d21badd5341 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.148305 Jun 02 13:23:42.225819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 227/406] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:42 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:42.837861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:42.838473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:42.845122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.845571 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:42.846357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.846793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:42.864715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.974629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:42.975629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:42.976275 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:42.982825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7e56702d-126a-44be-9c89-d1f3f3ae3270 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.149141 Jun 02 13:23:42.983403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 180/407] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:42 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:42.983959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.984382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:42.985156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:42.985593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:43.047463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:43.054869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b30cbab5-82b5-48e7-8f3e-abbfa27fe754 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.083152 Jun 02 13:23:43.055435 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 228/408] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:42 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:43.242101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:43.242633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:43.245567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.249061 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:43.249534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:43.250308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:43.250738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:43.380928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:43.389207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fb25b5c9-1eeb-421c-9b06-24f63d1f12c3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.151110 Jun 02 13:23:43.389789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 181/409] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:43 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:43.999444 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:44.000087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:44.006635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.007100 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.007978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.008335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.070913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:44.071522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:44.074199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.075239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=24 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.080194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.080646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.081419 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.081851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.140281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:44.147283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:44.148032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-291e505a-a115-4b79-a122-9fb575121b2f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.153091 Jun 02 13:23:44.148609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 229/410] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:43 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:44.155046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f36922ea-16d1-45fc-8425-b218a74fef31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.087789 Jun 02 13:23:44.155427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 182/411] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:44 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:44.406471 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:44.407063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:44.408981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=8 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.414077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.414521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.415281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:44.415714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:44.556620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:44.564195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-768e997f-d775-4750-bed1-d97b2ab17416 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.162062 Jun 02 13:23:44.564964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 230/412] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:44 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:45.164890 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:45.166265 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:45.171073 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:45.172292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:45.175348 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.176041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.177069 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.177649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.178938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.179655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.180528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.181030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.307295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:45.315546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1711c2a0-d285-4e28-84ea-98552eeab832 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1260 microversion: 2.1 time: 0.148412 Jun 02 13:23:45.316794 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 231/413] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:45 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:45.328966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:45.337765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-064ac1df-167f-4534-9e18-c6160443a746 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.176504 Jun 02 13:23:45.338412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 183/414] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:45 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:45.580320 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:45.580939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:45.586905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.587624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.588419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:45.588859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:45.714560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:45.721941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-90de1ef2-71a2-4417-aba5-3e9bf1d3b4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.145666 Jun 02 13:23:45.722505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 232/415] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:45 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:46.332953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:46.333497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:46.340314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.341323 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.342082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.342518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.354584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:46.355185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:46.361466 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.361909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.362734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.363169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.402773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:46.411159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0afa316f-7e9a-4fd1-a06f-3004700f4157 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1252 microversion: 2.1 time: 0.082106 Jun 02 13:23:46.411731 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 184/416] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:46 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1252 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:46.499023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:46.507295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-84ce38e5-3c73-4c09-a360-41962ceba551 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.156610 Jun 02 13:23:46.507901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 233/417] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:46 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:46.738434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:46.739035 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:46.745041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.745478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.746220 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:46.747157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:46.874783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:46.882577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-224ae6c6-20ce-46a9-abd3-ef9c11ac5441 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.147816 Jun 02 13:23:46.883173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 185/418] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:46 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:47.431757 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:47.432435 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:47.439210 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.439668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:47.440490 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.440931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:47.507043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:47.515235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-330c7461-3c8c-469f-9016-2f4629ddfbb7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1308 microversion: 2.1 time: 0.087344 Jun 02 13:23:47.515821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 234/419] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:47 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:47.526058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:47.526686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:47.532762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.533200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:47.533953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.534382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:47.676332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:47.683661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-206fad4e-6898-4b66-a80b-16b81529331c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.161958 Jun 02 13:23:47.684763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 186/420] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:47 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:47.899390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:47.900015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:47.906722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.907165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:47.907947 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:47.908379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:48.071803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:48.080219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8bb364dc-762a-4455-9273-1c729d8ab0ee tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.184610 Jun 02 13:23:48.080883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 235/421] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:47 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:48.531176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:48.531784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:48.538316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:48.538757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:48.539511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:48.539976 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:48.599312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:48.607029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-23edadb6-6560-4131-b706-ae953c8491d4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1308 microversion: 2.1 time: 0.079725 Jun 02 13:23:48.607589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 187/422] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:48 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1308 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:48.700329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:48.700939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:48.707001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:48.707443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:48.708228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:48.708660 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:48.834445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:48.842175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b2b948f0-4f5a-44f1-b292-23516bdd5021 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.145681 Jun 02 13:23:48.842729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 236/423] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:48 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:49.097186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:49.097794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:49.103795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.104282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.105038 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.105472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.233826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:49.241391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a9ad1fa1-7b6b-447b-9c65-c594337db000 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.148105 Jun 02 13:23:49.241964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 188/424] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:49 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:49.680610 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:49.681215 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:49.687314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.687763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.688553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.688986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.753174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:49.760645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-59ee2c7b-b2f4-4d1d-a659-0f6e289bbba9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1308 microversion: 2.1 time: 0.083944 Jun 02 13:23:49.761207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 237/425] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:49 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:49.858867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:49.860349 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:49.866878 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.867336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.868107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:49.868534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:49.992172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:50.000405 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cdf2b03b-d70b-4107-9fab-70b23f18e73c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.145693 Jun 02 13:23:50.001202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 189/426] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:49 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:50.258462 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:50.259147 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:50.265351 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:50.265797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:50.266571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:50.266995 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:50.541218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:50.541218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-22877c30-025c-438d-8f9b-819124b0fc4c tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.268305 Jun 02 13:23:50.541218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 238/427] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:50 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:50.778388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:50.779410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:50.786354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:50.787324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:50.788213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:50.788643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:50.853520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:50.861990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9f169bc3-4cb2-418d-a27c-52e84025fbc9 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1316 microversion: 2.1 time: 0.087948 Jun 02 13:23:50.862753 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 190/428] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:50 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:51.016886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:51.017509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:51.024008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.024460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:51.025266 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.025701 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:51.534496 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:51.542739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:51.542739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:51.545789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9f5e4fd1-2c84-4004-a20a-f4bcbce6c296 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.532633 Jun 02 13:23:51.547613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.548347 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:51.549446 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.550089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:51.557088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 239/429] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:51 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:51.767491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:51.776502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2756b59c-6698-4f27-9ae8-84c8227b6ac3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.240211 Jun 02 13:23:51.777409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 191/430] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:51 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:51.883202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:51.884247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:51.896861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.897316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:51.898413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:51.899035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:52.058317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:52.067424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a894400-5aa9-4579-9149-8fa9dcff0000 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1368 microversion: 2.1 time: 0.190760 Jun 02 13:23:52.069360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 240/431] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:51 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:52.516766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-e9be8889-3f3d-4494-95de-5ed39e4bc7d7 req-13971ac3-4ad6-42c8-992b-34f04fc4dd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d210210c-6ba3-4776-a622-19ed9a44668d", "name": "network-vif-plugged", "status": "completed", "tag": "7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:52.525986 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e9be8889-3f3d-4494-95de-5ed39e4bc7d7 req-13971ac3-4ad6-42c8-992b-34f04fc4dd56 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:52.526435 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e9be8889-3f3d-4494-95de-5ed39e4bc7d7 req-13971ac3-4ad6-42c8-992b-34f04fc4dd56 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:52.537714 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-e9be8889-3f3d-4494-95de-5ed39e4bc7d7 req-13971ac3-4ad6-42c8-992b-34f04fc4dd56 service nova] Creating event network-vif-plugged:7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b for instance d210210c-6ba3-4776-a622-19ed9a44668d on hv-cinder-79760 Jun 02 13:23:52.544049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-e9be8889-3f3d-4494-95de-5ed39e4bc7d7 req-13971ac3-4ad6-42c8-992b-34f04fc4dd56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031232 Jun 02 13:23:52.544049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 192/432] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:52.562941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:52.563551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:52.569625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:52.570076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:52.572432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:52.572432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:52.590139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.715762 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:52.723147 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b4d295d0-1971-4139-8107-314023e5b16f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.164621 Jun 02 13:23:52.723708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 241/433] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:52 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:52.794870 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:52.795567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:52.801766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:52.802252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:52.805891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:52.806368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:53.085951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:53.093211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:53.098503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:53.099146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:53.100138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:53.104365 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:53.184212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:53.201003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fcb1c2f0-df4c-4fb5-9b4d-b30e5cdd3f25 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.411261 Jun 02 13:23:53.210408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 193/434] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:52 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:53.248599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:53.256676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ecbc4b4-871a-45ed-9f5a-6553cf60b729 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1368 microversion: 2.1 time: 0.174647 Jun 02 13:23:53.257291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 242/435] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:53 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:53.740651 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:53.741215 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:53.747820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:53.748308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:53.749078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:53.749513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:53.878634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:53.886648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f6a45264-bb34-45c3-a836-93f7b3cb319d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.149991 Jun 02 13:23:53.887757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 194/436] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:53 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:54.217915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:54.232376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:54.232376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.232376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:54.232376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.233347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:54.273860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:54.274460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:54.280870 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.281584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:54.282433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.283018 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:54.368503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:54.376741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9593ab4f-0262-4855-9fc8-d2d9c72d78a9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.162852 Jun 02 13:23:54.377659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 243/437] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:54 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:54.428491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:54.436467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-92e32056-12ad-4bc8-88af-7448bd8f7a89 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1368 microversion: 2.1 time: 0.166675 Jun 02 13:23:54.437034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 195/438] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:54 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:54.905565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:54.906235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:54.913135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.913868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:54.914680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:54.915111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.174415 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:55.182359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b527a4d9-ce6d-4625-8e86-7e47a1df0178 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.281756 Jun 02 13:23:55.183288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 244/439] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:54 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:55.398566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:55.399700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:55.413105 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:55.416413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.416413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:55.416413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.443915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7a0eb18f-2778-4673-85dc-fb9ff3c8a2be req-3ac0cddc-bbbf-4c83-ba25-b109e86fe8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:55.458651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7a0eb18f-2778-4673-85dc-fb9ff3c8a2be req-3ac0cddc-bbbf-4c83-ba25-b109e86fe8eb service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:55.459104 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7a0eb18f-2778-4673-85dc-fb9ff3c8a2be req-3ac0cddc-bbbf-4c83-ba25-b109e86fe8eb service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.484953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7a0eb18f-2778-4673-85dc-fb9ff3c8a2be req-3ac0cddc-bbbf-4c83-ba25-b109e86fe8eb service nova] Creating event network-changed:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:23:55.494878 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7a0eb18f-2778-4673-85dc-fb9ff3c8a2be req-3ac0cddc-bbbf-4c83-ba25-b109e86fe8eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055024 Jun 02 13:23:55.495486 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 245/440] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:23:55.510261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:55.510261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:55.533101 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:55.533804 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.534749 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:55.535342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:55.642245 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:55.649589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1ceb82a9-9ba8-4e17-b08d-545eca2f5db1 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.258985 Jun 02 13:23:55.650884 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 196/441] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:55 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:55.739803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:55.772847 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-86e4d772-6d24-4017-ad39-f3e284cb549f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.272541 Jun 02 13:23:55.774362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 246/442] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:55 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:56.201668 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:56.202308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:56.209150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.209601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.210365 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.210845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.365205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:56.372149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.375090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-25dfc2a8-e40a-4019-b15b-35fb4948d70b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.178660 Jun 02 13:23:56.375682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 197/443] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:56 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:56.667687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:56.669689 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:56.681804 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.682567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.684311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.688913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.791391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:56.792054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:56.800644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.803166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.803166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:56.803166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:56.877414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:56.881505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ccf211af-6414-4bf6-8987-516804727ff8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.218701 Jun 02 13:23:56.892592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 247/444] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:56 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:56.983151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:56.991791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-435dd100-8d5c-4806-b799-17fea0cbb1d7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.204389 Jun 02 13:23:57.001733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 198/445] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:56 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:57.394777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:57.395060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:57.399820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:57.402912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:57.403600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:57.404409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:57.404844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:57.556471 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:57.564640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eafd16f4-ab44-4c4b-bf88-32c8ec79f39f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.175479 Jun 02 13:23:57.565212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 248/446] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:57 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:57.898650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:57.899262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:57.906659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:57.907100 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:57.907954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:57.908332 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.009142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:58.009946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:58.027044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:58.028487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.028809 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:58.029245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.064033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:58.072726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-784414ec-76df-45ca-b50c-29f079c36bc7 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.177957 Jun 02 13:23:58.073322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 199/447] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:57 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:58.233281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:58.241377 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-07b1e546-36d2-4136-b102-bdf499547e48 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.236432 Jun 02 13:23:58.242009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 249/448] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:58 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:58.548340 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-c8d70def-2bd6-4cb7-a9a3-3af5d1eed4a0 req-561ffba9-3bee-4280-aec2-444785203242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e727ae-ed6d-4ffa-9ff6-15720b19cab8", "name": "network-vif-plugged", "status": "completed", "tag": "5ce65711-1669-4da7-af73-7be574b09260"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:23:58.566330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c8d70def-2bd6-4cb7-a9a3-3af5d1eed4a0 req-561ffba9-3bee-4280-aec2-444785203242 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:58.569777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c8d70def-2bd6-4cb7-a9a3-3af5d1eed4a0 req-561ffba9-3bee-4280-aec2-444785203242 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.604929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:58.604929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:58.605137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-c8d70def-2bd6-4cb7-a9a3-3af5d1eed4a0 req-561ffba9-3bee-4280-aec2-444785203242 service nova] Creating event network-vif-plugged:5ce65711-1669-4da7-af73-7be574b09260 for instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 on hv-cinder-79760 Jun 02 13:23:58.605221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:58.605221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.605221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:58.605221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:58.605537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-c8d70def-2bd6-4cb7-a9a3-3af5d1eed4a0 req-561ffba9-3bee-4280-aec2-444785203242 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054461 Jun 02 13:23:58.605537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 200/449] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:23:58.792543 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:58.809612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e823c4e3-61eb-4d96-930f-a1e339010456 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.231082 Jun 02 13:23:58.814727 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 250/450] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:58 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:59.092389 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:59.093445 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:59.100472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.100919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:59.101690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.102117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:59.260101 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:59.261463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:59.263483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:59.264806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:23:59.265270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 (ip 10.222.0.46) !!! Jun 02 13:23:59.273266 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.274446 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:59.275689 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.276406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:59.287379 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-698038c2-ca28-4f00-901c-5e9be5db1634 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.200649 Jun 02 13:23:59.298096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 201/451] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:59 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:59.528723 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:23:59.539438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9e4ee379-01b7-42d4-b475-ca66ba65ae36 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.283941 Jun 02 13:23:59.540508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 251/452] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:59 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:59.826822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:23:59.828457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:23:59.838839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.839523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:23:59.840844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:23:59.841468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:00.113296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:00.129945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d367900e-50d0-4852-9b45-be8e38d2b909 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.306798 Jun 02 13:24:00.144614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 202/453] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:23:59 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:00.305327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:00.310188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:00.313023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:00.313481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:00.314252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:00.314842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:00.551377 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:00.559851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:00.559851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:00.561670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-92769b4a-f23c-4aeb-bb58-1fb40824d5e3 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.260078 Jun 02 13:24:00.562568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 252/454] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:00 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:00.576706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:00.577732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:00.578656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:00.579092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:00.727624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:00.736967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e3a88f1b-8ece-4db7-96ea-5cfe82183f74 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.183179 Jun 02 13:24:00.746441 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 203/455] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:00 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:01.150845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:01.151545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:01.160881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.161339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.162378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.163001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.313909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:01.324428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-71502b67-aca2-46a7-83d3-434ca45aa08a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.177295 Jun 02 13:24:01.325648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 253/456] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:01 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:01.580799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:01.582203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:01.591794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.592269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.593069 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.593505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.739952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:01.748966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-08023264-7202-47ef-9c6f-c9eb35c6e970 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.172960 Jun 02 13:24:01.750296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 204/457] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:01 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:01.754729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:01.755564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:01.770576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.771546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.773972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:01.776347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:01.950496 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:01.962791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6d601cb8-7721-4ae6-86c0-c568582e6f5b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.212420 Jun 02 13:24:01.976050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 254/458] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:01 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:02.344546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:02.348481 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:02.352948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:02.353601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:02.354376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:02.354810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:02.526439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:02.534873 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e81c00d2-6bf8-4d8e-8e89-7dae79e38c9b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.195768 Jun 02 13:24:02.535721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 205/459] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:02 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:02.770597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:02.771227 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:02.777436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:02.777997 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:02.778729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:02.779169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:02.930534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:02.941348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c0621e04-3d21-44b3-bd1e-a194a7843d5d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.174185 Jun 02 13:24:02.942134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 255/460] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:02 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:02.993586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:02.995429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:03.003067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.003645 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:03.004598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.005118 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:03.184250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:03.199477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-51c5c5c9-b45a-4fdd-ab05-bf9dc6fabcc2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.216341 Jun 02 13:24:03.200143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 206/461] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:02 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:03.554514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:03.555496 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:03.562925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.563374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:03.564213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.564648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:03.706350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:03.714967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-94ad2d45-11bb-460e-a71b-977475dd7e75 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.165433 Jun 02 13:24:03.716130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 256/462] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:03 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:03.957884 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:03.958659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:03.965766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.966305 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:03.967182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:03.967691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:04.122655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:04.131191 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-39da9f34-96c4-4286-8c2d-e6428937e56d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.177194 Jun 02 13:24:04.131918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 207/463] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:03 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:04.217424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:04.218023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:04.224633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:04.225076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:04.225846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:04.226277 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:04.369341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:04.377597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-859a9f88-3581-4f35-a010-5764b9555640 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.164029 Jun 02 13:24:04.378171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 257/464] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:04 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:04.732496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:04.733173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:04.739819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:04.740324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:04.741161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:04.741611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:04.879519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:04.887424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-725650fc-1d53-4803-bdeb-50857ff4c95e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.159792 Jun 02 13:24:04.888075 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 208/465] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:04 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:05.148946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:05.149625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:05.156553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.157009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:05.157805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.158318 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:05.301712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:05.305489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.310139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ca01e45-65eb-42c3-9a55-864e8cc5ef11 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.165086 Jun 02 13:24:05.310723 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 258/466] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:05 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:05.394799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:05.395451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:05.402494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.403110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:05.404370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.404822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:05.535754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:05.543126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1078830c-39b7-4535-b6bc-d3d2f280ffd8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.152555 Jun 02 13:24:05.543735 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 209/467] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:05 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:05.905177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:05.905808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:05.912624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.913067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:05.913842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:05.914271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:06.053909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:06.061990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-039dfdca-044b-4ac2-b043-a0a1de594988 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.160687 Jun 02 13:24:06.062544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 259/468] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:05 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:06.327116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:06.327635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:06.333782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:06.334236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:06.335026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:06.335477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:06.466354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:06.473895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ccc40f3d-2e9c-4a81-ba6c-c159ed397693 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.150822 Jun 02 13:24:06.474457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 210/469] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:06 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:06.561093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:06.561780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:06.568363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:06.568825 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:06.569670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:06.570154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:06.705272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:06.713082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-93a13d24-f3b7-4e01-b708-dd5bd6c71f8f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.156474 Jun 02 13:24:06.713658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 260/470] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:06 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:07.079128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:07.079649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:07.085899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.086335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.087080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.087763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.217721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:07.225259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6c23c9ab-75bf-4b4b-a417-1dd0e08bee1a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.150642 Jun 02 13:24:07.225821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 211/471] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:07 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:07.490627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:07.491232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:07.497478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.497921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.498683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.499132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.628466 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:07.635834 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cf67ab33-96f4-4047-bc7f-60dfbc780ed4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.149117 Jun 02 13:24:07.636421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 261/472] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:07 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:07.730495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:07.731078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:07.737492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.737929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.738682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:07.739111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:07.868020 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:07.875860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7e388363-0970-49c3-a3f1-97b915ee1b54 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.149208 Jun 02 13:24:07.876451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 212/473] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:07 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:08.242604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:08.243199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:08.250019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.250395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:08.251143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.251570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:08.380924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:08.389045 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1a42cafd-007c-4baf-a582-25b05192d396 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.150336 Jun 02 13:24:08.389611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 262/474] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:08 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:08.653776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:08.654404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:08.660508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.660958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:08.661962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.662165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:08.797722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:08.805479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-774d801d-a637-40c6-9b9b-f3d157ac9127 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.155758 Jun 02 13:24:08.806047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 213/475] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:08 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:08.892186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:08.892780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:08.898783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.899227 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:08.900097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:08.900534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:09.026474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:09.033831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bbc96175-95c5-4ca0-8d1a-c2862ee3809e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.145566 Jun 02 13:24:09.034435 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 263/476] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:08 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:09.406357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:09.406964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:09.413105 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:09.413586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:09.414351 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:09.414789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:09.542106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:09.549560 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0887f15e-0ca1-4b10-a984-e6c3918bba55 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.147712 Jun 02 13:24:09.550121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 214/477] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:09 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:09.823230 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:09.823737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:09.831584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:09.833052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:09.833901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:09.834401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:10.039247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:10.056367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ed78f5c4-0dd3-4a44-be56-550ce46a0f76 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1313 microversion: 2.1 time: 0.228058 Jun 02 13:24:10.056367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 264/478] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:09 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:10.056629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:10.056629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:10.060793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:10.061272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:10.062112 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:10.062565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:10.067137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:10.203633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:10.211069 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5430a3f2-7a7a-48c5-a9ac-fb9fc77dec96 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.164384 Jun 02 13:24:10.211652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 215/479] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:10 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:10.566474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:10.567084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:10.573069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:10.573505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:10.574263 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:10.575206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:10.706430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:10.714233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a3221606-68e7-484b-867a-48e72865f634 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.151686 Jun 02 13:24:10.714790 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 265/480] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:10 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:11.065515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:11.066124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:11.072793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.073233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.073994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.074427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.204160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:11.212030 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2575b1c5-33b7-4abd-99d2-e09fe32095e9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1496 microversion: 2.1 time: 0.150239 Jun 02 13:24:11.213124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 216/481] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:11 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:11.229908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:11.231182 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:11.240658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.241344 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.242273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.242850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.446022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:11.455163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34d5a4e0-b5b9-476f-97ca-6b9abe7f5215 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.228753 Jun 02 13:24:11.456162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 266/482] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:11 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:11.731588 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:11.732494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:11.738918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.739373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.740159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:11.747764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:11.886302 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:11.894644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f164d7fd-93c9-4cf8-bcbd-e24a4c9ec8e3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.168494 Jun 02 13:24:11.896197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 217/483] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:11 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:12.278474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:12.279176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:12.285270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.285725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.286458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.286887 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.311729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:24:12.473263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:12.473959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:12.480792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.481239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.482543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.482984 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.619652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:12.628340 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-137a920d-a66a-4754-8290-f23551e75100 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.159022 Jun 02 13:24:12.628908 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 218/484] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:12 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:12.659566 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a0d5db49-1e42-464e-90f5-c144c47384f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 204 len: 0 microversion: 2.1 time: 0.384669 Jun 02 13:24:12.660204 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 267/485] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:24:12 2022] DELETE /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:24:12.671482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:12.672120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:12.678293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.678746 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.679509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.679978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.812607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:12.820447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3914e16-e25d-4137-b895-5a5f90def743 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1502 microversion: 2.1 time: 0.155729 Jun 02 13:24:12.821014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 219/486] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:12 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:12.913160 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:12.913860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:12.920691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.921142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:12.921906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:12.922343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:13.071548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:13.079195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a5e8a220-c48a-4b53-9edc-fc4d840a962e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.170196 Jun 02 13:24:13.079760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 268/487] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:12 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:13.654462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:13.654998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:13.661509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:13.662046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:13.662829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:13.663235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:13.791949 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:13.799827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7ebbf353-437a-4941-a480-012a3faaebb4 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.149909 Jun 02 13:24:13.800416 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 220/488] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:13 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:13.838253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:13.838868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:13.845845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:13.846285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:13.847113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:13.847539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:13.975560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:13.983898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-89e8b765-765d-4e48-b55c-cdd6201c22a8 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1502 microversion: 2.1 time: 0.150006 Jun 02 13:24:13.984526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 269/489] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:13 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:14.096287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:14.096894 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:14.098792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=79 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:14.103470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:14.103947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:14.104699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:14.105126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:14.239905 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:14.247275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ab1ac482-dec5-4d41-9b0f-00486e613d0a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.155447 Jun 02 13:24:14.247832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 221/490] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:14 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:14.816851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:14.817497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:14.823399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:14.823834 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:14.824613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:14.825041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:14.957115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:14.962547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-228f62f1-f262-4912-b0ce-9fdbea7eb1d2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.149338 Jun 02 13:24:14.963128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 270/491] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:14 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:15.001280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:15.001882 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:15.008699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.009153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.010582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.010582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.139667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:15.147151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aaaa3e2b-a036-41bd-84c5-b862d0933071 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1502 microversion: 2.1 time: 0.150519 Jun 02 13:24:15.147716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 222/492] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:14 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:15.214354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:15.214774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:15.223192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.223192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.223192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.223578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.246488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d2f68cbd-d198-4f63-a902-2ff6cc429c98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/ips" status: 200 len: 146 microversion: 2.1 time: 0.036402 Jun 02 13:24:15.247047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 271/493] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:24:15 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:15.264015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:15.264624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:15.270630 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.271078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.271828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.272292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.406071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:15.413584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f1c91c58-801f-4bec-8251-dd7974d76dae tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1319 microversion: 2.1 time: 0.153516 Jun 02 13:24:15.414143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 223/494] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:15 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:15.980066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:15.980760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:15.986881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.987326 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:15.988237 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:15.988678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:16.118857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:16.126899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b52c577-8850-4e47-b9f2-0bcc50f3e956 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.150935 Jun 02 13:24:16.127465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 272/495] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:15 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:16.165584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:16.166253 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:16.173463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:16.173914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:16.174695 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:16.175183 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:16.314014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:16.321743 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-015d57ba-a833-4022-a22f-a2e6b41f0380 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1502 microversion: 2.1 time: 0.160747 Jun 02 13:24:16.322313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 224/496] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:16 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:16.432531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:16.433195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:16.442184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:16.442893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:16.443736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:16.444209 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:16.595527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:16.603094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2a18141-8097-459f-9121-c42d054757de tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1509 microversion: 2.1 time: 0.176119 Jun 02 13:24:16.603660 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 273/497] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:16 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:17.144842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:17.145611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:17.151997 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:17.157616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:17.157616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:17.157616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:17.291148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:17.300825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6ec8c6fe-7ee6-4707-a266-48412f74aff6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.159821 Jun 02 13:24:17.301407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 225/498] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:17 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:17.339550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:17.340225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:17.346758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:17.347196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:17.347993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:17.348424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:17.369315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.516895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:17.524991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b0de7dd-c5b8-4588-95b6-da58071a79e4 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1502 microversion: 2.1 time: 0.189350 Jun 02 13:24:17.525487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 274/499] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:17 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:18.318054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:18.319343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:18.326255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:18.326255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:18.327376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:18.328051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:18.497202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:18.505346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-63069ad8-ea48-4ce8-9b0c-5ace7d870eda tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.191293 Jun 02 13:24:18.505939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 226/500] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:18 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:18.542575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:18.543193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:18.550285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:18.553262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:18.553262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:18.553262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:18.631717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:18.645605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6e04b247-6cac-4b4d-99a5-7215790ddd3e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1460 microversion: 2.1 time: 0.106768 Jun 02 13:24:18.646514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 275/501] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:18 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1460 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:18.746867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-bbbc7155-2b32-42a1-b8b5-7daff2b1416d req-6c8c0ed8-3f78-422d-a96d-9e273d12948d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d210210c-6ba3-4776-a622-19ed9a44668d", "name": "network-vif-deleted", "tag": "7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:18.755751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bbbc7155-2b32-42a1-b8b5-7daff2b1416d req-6c8c0ed8-3f78-422d-a96d-9e273d12948d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:18.763203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bbbc7155-2b32-42a1-b8b5-7daff2b1416d req-6c8c0ed8-3f78-422d-a96d-9e273d12948d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:18.769580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-bbbc7155-2b32-42a1-b8b5-7daff2b1416d req-6c8c0ed8-3f78-422d-a96d-9e273d12948d service nova] Creating event network-vif-deleted:7dc132bc-6a7e-4b7e-9e1d-d945e9a53c1b for instance d210210c-6ba3-4776-a622-19ed9a44668d on hv-cinder-79760 Jun 02 13:24:18.775209 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-bbbc7155-2b32-42a1-b8b5-7daff2b1416d req-6c8c0ed8-3f78-422d-a96d-9e273d12948d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Jun 02 13:24:18.776413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 227/502] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:19.220070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7bf53ff3-7a08-489a-a035-7c6f38dcbc17 req-a97cc1d0-adbc-4471-a6bc-461da80789a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "name": "network-vif-plugged", "status": "completed", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:19.228741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7bf53ff3-7a08-489a-a035-7c6f38dcbc17 req-a97cc1d0-adbc-4471-a6bc-461da80789a5 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.229189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7bf53ff3-7a08-489a-a035-7c6f38dcbc17 req-a97cc1d0-adbc-4471-a6bc-461da80789a5 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.240607 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7bf53ff3-7a08-489a-a035-7c6f38dcbc17 req-a97cc1d0-adbc-4471-a6bc-461da80789a5 service nova] Creating event network-vif-plugged:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:24:19.245927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7bf53ff3-7a08-489a-a035-7c6f38dcbc17 req-a97cc1d0-adbc-4471-a6bc-461da80789a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033174 Jun 02 13:24:19.246582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 276/503] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:19.524177 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:19.524834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:19.533245 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.539534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.539534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.539534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.664548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:19.665395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:19.689154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:19.690413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.690893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.691692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.692162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.710777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-772a2311-6273-4e81-87d5-4368aa777ac6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.191038 Jun 02 13:24:19.717896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 228/504] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:19 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:19.733596 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:19.734116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:19.734630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lazy-loading 'fault' on Instance uuid d210210c-6ba3-4776-a622-19ed9a44668d {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:24:19.785282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:19.793503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-75e6ffdb-741e-47cc-a77a-72da1b7ef4fd tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 200 len: 1303 microversion: 2.1 time: 0.133240 Jun 02 13:24:19.794169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 277/505] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:19 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:20.156563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e84d3c83-5634-4dba-b840-7e53e81935bd"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:20.157781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:20.165421 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.165947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.166793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.167228 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.734322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:20.734867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:20.741093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.741480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.742243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.742674 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.876098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:20.883983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f3ebc365-8418-46c0-8a88-b5c4fb6f00a7 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.154128 Jun 02 13:24:20.884553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 278/506] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:20 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:20.891012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:20.891620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: d210210c-6ba3-4776-a622-19ed9a44668d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:20.898095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.898538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.899294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:20.899730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:20.912961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] HTTP exception thrown: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Request method failure captured: Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d HTTP/1.1 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLnIa21ydoxBtTK0a4b_K9AinthgA1-BQjSa3y--sbZFJ6msmNIJE_QLcRa6ElaZrIyUF6wnOsQQT6D4h7rP0DwNbiVnNxhfJoe3xcfR8-FGJhSJC31ACXZi0vWZCSME2F0xV6n_7kYyZG8hdzT34mpjl0qZE4jsylEwTzuXF6r32WI Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: d8e983852747461b8ca663cd6ff56ff4 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesActionsTest-550368238 Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:24:20.914580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d8e983852747461b8ca663cd6ff56ff4"}]}] Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesActionsTest-550368238 Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: d8e983852747461b8ca663cd6ff56ff4 Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesActionsTest-550368238 Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesActionsTest-550368238-project Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 022e761cfc694697b0ef9886025abc5e Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesActionsTest-550368238-project Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. Jun 02 13:24:20.916122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'd210210c-6ba3-4776-a622-19ed9a44668d'} Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:24:20.917766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. Jun 02 13:24:20.920844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:20.922063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Returning 404 to user: Instance d210210c-6ba3-4776-a622-19ed9a44668d could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:24:20.922063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f3c6aa1-703d-4f31-871e-cbcabad85cfe tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d" status: 404 len: 111 microversion: 2.1 time: 0.030607 Jun 02 13:24:20.922063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 279/507] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:20 2022] GET /compute/v2.1/servers/d210210c-6ba3-4776-a622-19ed9a44668d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:24:21.020556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-660740148", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "networks": [{"uuid": "7733cbbd-faa4-4f7a-ae06-7ebe69144a00"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:21.074563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] validate_networks() for [('7733cbbd-faa4-4f7a-ae06-7ebe69144a00', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:24:21.451541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:24:21.452060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:24:21.452600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:24:21.453190 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:24:21.453602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:24:21.463311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:21.463847 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:21.464689 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:21.465127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:21.482922 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Getting quotas for project d8e983852747461b8ca663cd6ff56ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:24:21.486946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Getting quotas for user 022e761cfc694697b0ef9886025abc5e and project d8e983852747461b8ca663cd6ff56ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:24:21.498673 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:24:21.500979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:24:21.572966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aeaf9dfb-a008-4e29-9528-e8e23cf27d0f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.422901 Jun 02 13:24:21.573782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 229/508] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:24:20 2022] POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments => generated 194 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:21.643758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5affec18-885e-4906-8c57-04badfe9c13b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627160 Jun 02 13:24:21.644539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 280/509] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:24:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:24:21.655987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-163f7d35-dc4f-4dbb-bccb-510bc704992e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:21.656690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-163f7d35-dc4f-4dbb-bccb-510bc704992e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:21.713248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-163f7d35-dc4f-4dbb-bccb-510bc704992e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:21.720954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-163f7d35-dc4f-4dbb-bccb-510bc704992e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1213 microversion: 2.1 time: 0.069009 Jun 02 13:24:21.730594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 230/510] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:21 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:21.901688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:21.902213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:21.910195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:21.910642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:21.911403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:21.911984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:22.081236 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:22.089906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-18174132-7b90-43e9-97da-91be37d47105 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1356 microversion: 2.1 time: 0.192638 Jun 02 13:24:22.090547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 281/511] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:21 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:22.739690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:22.741917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:22.750940 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:22.751386 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:22.752186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:22.752699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:22.817025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:22.825990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1604093a-247f-4ce2-9ec4-3434bb2de08d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1217 microversion: 2.1 time: 0.090695 Jun 02 13:24:22.827052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 231/512] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:22 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:23.108293 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.108966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:23.116209 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.116674 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.117433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.117868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.256138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:23.264553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9f8529c4-045f-4004-be5f-f80293e20f22 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1547 microversion: 2.1 time: 0.161857 Jun 02 13:24:23.265132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 282/513] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:23.281154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.281765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:23.287757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.288238 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.289007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.289433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.293621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:23.422155 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:23.430098 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d1a0847d-c769-4a11-a1d2-a833db26c2e2 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1547 microversion: 2.1 time: 0.153122 Jun 02 13:24:23.430592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 232/514] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:23.446371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.452618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:23.452618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Searching by: {'deleted': False, 'project_id': '81684485980545cda977f1d7e72f90e2'} {{(pid=118132) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 13:24:23.457799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.458175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.458955 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.459538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.559064 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.multi_cell_list [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 13:24:23.660832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-050bb0c1-34c8-4552-8aee-a80528ca173b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218082 Jun 02 13:24:23.661411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 283/515] 10.222.0.46 () {58 vars in 1124 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:23.672316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.672925 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:23.679130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.679573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.680370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.680843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.752389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.753151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:23.762487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.762938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.763716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.764165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.795972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3c77ce1c-c3d7-4efd-83ef-639adb15d4aa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/ips" status: 200 len: 153 microversion: 2.20 time: 0.047959 Jun 02 13:24:23.796538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 284/516] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/ips => generated 153 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:24:23.839185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:23.847158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:23.848071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:23.849286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-83bc38b6-8637-4c2c-acc6-611b623d6db8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1547 microversion: 2.1 time: 0.181492 Jun 02 13:24:23.857719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.858346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.859376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:23.859807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:23.861423 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 233/517] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:23.968394 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:23.988677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f80b69d7-596a-451e-8605-73f9b6e57559 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1273 microversion: 2.1 time: 0.146685 Jun 02 13:24:24.000319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 285/518] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:23 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:25.006809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:25.007411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:25.014725 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:25.015223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:25.020799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:25.020799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:25.152290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:25.160581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e0bd7bc3-92f0-4f16-adbb-9deb83d341f9 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.157764 Jun 02 13:24:25.161254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 234/519] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:25 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:25.680232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7fb8988c-2c71-46cb-8464-e9a77d8c94e4 req-d83f9e0f-ef4e-417f-9838-4776020d5680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0556133a-aaed-4159-8e00-b3c9bf87fb71", "tag": "e6a0135a-6286-452e-b500-b917af8ca425"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:25.689567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7fb8988c-2c71-46cb-8464-e9a77d8c94e4 req-d83f9e0f-ef4e-417f-9838-4776020d5680 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:25.690457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7fb8988c-2c71-46cb-8464-e9a77d8c94e4 req-d83f9e0f-ef4e-417f-9838-4776020d5680 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:25.702356 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7fb8988c-2c71-46cb-8464-e9a77d8c94e4 req-d83f9e0f-ef4e-417f-9838-4776020d5680 service nova] Creating event network-changed:e6a0135a-6286-452e-b500-b917af8ca425 for instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 on hv-cinder-79760 Jun 02 13:24:25.707435 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7fb8988c-2c71-46cb-8464-e9a77d8c94e4 req-d83f9e0f-ef4e-417f-9838-4776020d5680 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031151 Jun 02 13:24:25.708139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 286/520] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:26.179324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:26.179995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:26.186981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:26.187424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:26.192357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:26.192357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:26.333111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:26.340931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ac4317b5-d739-48e1-b689-a54617dccf0e tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.165715 Jun 02 13:24:26.341555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 235/521] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:26 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:27.123958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18974cb1-7480-40fd-8f8b-b5fbc86491f4"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:27.125149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:27.128254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:27.131928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.132382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.133156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.133593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.357797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:27.358436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:27.365320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.365769 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.366627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.367011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.504435 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:27.512179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f95933e3-3ac9-4458-a55c-da859866e9ca tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.158565 Jun 02 13:24:27.512756 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 236/522] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:27 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:27.660844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:27.661374 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:27.667432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.667863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.668669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:27.669099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:27.693440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lazy-loading 'flavor' on Instance uuid 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:24:28.262922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fba94dee-c791-49c9-9f28-b9b212923d8d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/action" status: 202 len: 0 microversion: 2.20 time: 0.605867 Jun 02 13:24:28.263834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 237/523] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 2 13:24:27 2022] POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 02 13:24:28.272519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:28.273217 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:28.280688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:28.281141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:28.281961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:28.282395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:28.416048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:28.424844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:28.426549 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:28.427760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3845a67e-7b25-41bc-86a1-3b85abd416b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.159675 Jun 02 13:24:28.428619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 238/524] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:28 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:28.529960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:28.530533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:28.536849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:28.537288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:28.538119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:28.538502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:28.669433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:28.676966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f03d788-12af-49a5-94f9-eb9e8059960f tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.151581 Jun 02 13:24:28.677531 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 239/525] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:28 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:29.446556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:29.447187 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:29.454820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:29.455264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:29.456065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:29.456497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:29.587802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:29.595979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:29.597509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:29.598868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e9bc1b38-5c44-4d46-9171-137ba69b3981 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.156374 Jun 02 13:24:29.599437 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 240/526] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:29 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:29.694280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:29.694806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:29.700912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:29.701361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:29.702122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:29.702556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:29.836639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:29.844941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f2f1e738-9573-4f15-ad15-0df42b813d50 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.154573 Jun 02 13:24:29.845546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 241/527] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:29 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:30.616444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:30.617251 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:30.624403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:30.624844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:30.625598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:30.626030 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:30.754290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:30.762300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:30.763824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:30.764995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a50343d3-1876-44fd-b534-00b1b6087867 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.152561 Jun 02 13:24:30.765543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 242/528] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:30 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:30.862329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:30.862950 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:30.869136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:30.869459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:30.870251 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:30.870682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:31.011148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:31.018598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-47b3ad3e-bac0-4848-a308-24d3182f2590 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.160064 Jun 02 13:24:31.019164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 243/529] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:30 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:31.493957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:31.782538 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:31.785806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:31.785806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:31.790863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:31.791311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:31.792214 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:31.792648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:31.890130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f69e1786-4a4b-40ca-979b-dc628093599f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.771115 Jun 02 13:24:31.894937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 287/530] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:24:27 2022] POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments => generated 194 bytes in 4773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:31.926566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:31.939578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:31.939578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:31.939578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c03bd647-ec4e-4476-b3af-bdcf06167d11 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.159967 Jun 02 13:24:31.939888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 244/531] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:31 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:32.035846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:32.038670 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:32.045458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:32.045902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:32.046669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:32.047168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:32.182965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:32.191261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cc8ebe55-20b3-4a33-9cfd-0b536140a651 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.159796 Jun 02 13:24:32.191914 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 288/532] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:32 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:32.957171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:32.957757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:32.964558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:32.965002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:32.965761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:32.966192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.120351 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:33.120351 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:33.120607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:33.121190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-47a20bb2-8ea4-4a0d-8bcc-ad94b5423461 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.167930 Jun 02 13:24:33.121749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 245/533] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:32 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:33.207584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:33.208218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:33.214937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:33.221072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.221072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:33.221072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.368022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:33.376901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4694228a-c615-45d4-a02a-feb0234363f0 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.173044 Jun 02 13:24:33.377428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 289/534] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:33 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:33.392227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65efa59b-1a4f-4791-bfa6-f0ad10502551 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:33.398742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65efa59b-1a4f-4791-bfa6-f0ad10502551 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:33.399190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65efa59b-1a4f-4791-bfa6-f0ad10502551 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.461654 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-65efa59b-1a4f-4791-bfa6-f0ad10502551 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Going to try to stop instance {{(pid=118131) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 13:24:33.466233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:33.624164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-65efa59b-1a4f-4791-bfa6-f0ad10502551 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action" status: 202 len: 0 microversion: 2.1 time: 0.236544 Jun 02 13:24:33.624771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 246/535] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:24:33 2022] POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:24:33.633951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:33.634667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:33.636773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:33.641763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:33.642212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.642983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:33.643416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:33.776561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:33.784578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3741343a-e5b5-4b77-8621-29f294fbe53a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.155167 Jun 02 13:24:33.785155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 290/536] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:33 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:34.139700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:34.140440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:34.146666 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.147111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.147887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.148329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.303167 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:34.311284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:34.312854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:34.314378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae082111-9f7f-48a9-9498-7730b6426af4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.179504 Jun 02 13:24:34.314939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 247/537] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:34 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:34.395560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:34.396808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:34.402879 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.403324 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.404920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.406821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.548752 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:34.552077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:34.556261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3ddd8e92-abd8-4faa-b9bc-9a99f4a12f1b tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.164595 Jun 02 13:24:34.556899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 291/538] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:34 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:34.803083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:34.803623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:34.809820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.810759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.811519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:34.811978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:34.944447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:34.953167 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-243820fd-77c2-4a19-8f6c-d77ee670d799 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.154781 Jun 02 13:24:34.953741 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 248/539] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:34 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:35.333824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:35.334550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:35.341289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.342239 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.343015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.343454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.481848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:35.490690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:35.492226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:35.493441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3ccba00b-64db-4f5d-b685-3f350ca8927f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.163986 Jun 02 13:24:35.497033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 292/540] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:35 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:35.528410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-550af4ce-4fe5-4a46-ae1d-a1d1d8e60c39 req-21ab26a1-b8b2-4445-ac73-c38f9766077f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556133a-aaed-4159-8e00-b3c9bf87fb71", "name": "network-vif-plugged", "status": "completed", "tag": "e6a0135a-6286-452e-b500-b917af8ca425"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:35.538053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-550af4ce-4fe5-4a46-ae1d-a1d1d8e60c39 req-21ab26a1-b8b2-4445-ac73-c38f9766077f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.538494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-550af4ce-4fe5-4a46-ae1d-a1d1d8e60c39 req-21ab26a1-b8b2-4445-ac73-c38f9766077f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.550307 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-550af4ce-4fe5-4a46-ae1d-a1d1d8e60c39 req-21ab26a1-b8b2-4445-ac73-c38f9766077f service nova] Creating event network-vif-plugged:e6a0135a-6286-452e-b500-b917af8ca425 for instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 on hv-cinder-79760 Jun 02 13:24:35.555055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-550af4ce-4fe5-4a46-ae1d-a1d1d8e60c39 req-21ab26a1-b8b2-4445-ac73-c38f9766077f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030401 Jun 02 13:24:35.555652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 249/541] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:35.574777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:35.575384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:35.581915 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.582360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.583132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.583567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.719795 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:35.727494 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0bc5a821-58ac-40ec-83d3-9da6f027f531 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.156796 Jun 02 13:24:35.732605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 293/542] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:35 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:35.976906 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:35.980138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:35.984064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.984508 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:35.985284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:35.985713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:36.118842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:36.127391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c7261600-97f4-41c8-9563-24fecaec5994 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.154708 Jun 02 13:24:36.127985 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 250/543] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:35 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:36.511580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:36.512379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:36.518959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:36.519394 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:36.520199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:36.520620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:36.651099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:36.659177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:36.660734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:36.661894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f5d13a16-ff93-4ddf-98e0-c1810c0c9a03 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.154199 Jun 02 13:24:36.662455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 294/544] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:36 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:36.744381 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:36.744903 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:36.752163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:36.752607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:36.753368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:36.753801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:36.883778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:36.892077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a22d8e3e-d060-4dd1-956a-cedf8455fdd5 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.151499 Jun 02 13:24:36.892668 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 251/545] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:36 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:37.145362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:37.145964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:37.152001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.152442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:37.153196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.153630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:37.291788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:37.300389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9d9fd7a4-a072-479f-98f1-003e3047ecaf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.158798 Jun 02 13:24:37.300962 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 295/546] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:37 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:37.681887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:37.682433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:37.689122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.689572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:37.690366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.690801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:37.821812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:37.830891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:37.832409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:37.833564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5e34bec9-d4d1-4831-b277-4cd6aab342bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.155761 Jun 02 13:24:37.834126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 252/547] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:37 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:37.908731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:37.909309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:37.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.916243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:37.916994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:37.917424 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:38.049244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:38.056569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-07956145-b860-4fa4-80ee-61ed7ab974d2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1313 microversion: 2.1 time: 0.151670 Jun 02 13:24:38.057129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 296/548] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:37 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:38.318228 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:38.318860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:38.324818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:38.325308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:38.326213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:38.326651 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:38.462905 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:38.470844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-50548768-9049-4ff0-93e3-cb07c6c99ef1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.156503 Jun 02 13:24:38.471408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 253/549] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:38 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:38.851823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:38.852443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:38.858954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:38.859395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:38.860202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:38.860634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:38.994222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:39.008181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:39.009696 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:39.010846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-928090d8-ae94-43fe-9aac-842d1686aa67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.163052 Jun 02 13:24:39.011440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 297/550] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:38 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:39.074046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:39.074630 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:39.081298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:39.081738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:39.082487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:39.082914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:39.211797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:39.220084 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-df1e8db4-22cf-456c-99e7-5cdd2ce62ddf tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1496 microversion: 2.1 time: 0.149863 Jun 02 13:24:39.220640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 254/551] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:39 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:39.487912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:39.488455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:39.494473 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:39.494921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:39.495684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:39.496210 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:39.631568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:39.641097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3ce2acd2-ee34-4829-9024-0b7c8167164c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.157124 Jun 02 13:24:39.641664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 298/552] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:39 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:40.030197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:40.030829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:40.039260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.040278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.041311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.041311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.103896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:40.104441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:40.111294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.111738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.112555 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.112985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.139695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:24:40.187788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:40.195845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:40.197362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:40.198523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bb715314-d259-437c-be23-21f7063cee62 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.172877 Jun 02 13:24:40.199080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 255/553] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:40 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:40.442860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0ed65d6c-7fbc-4ac4-97fa-f2dc3d01b296 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 204 len: 0 microversion: 2.1 time: 0.342550 Jun 02 13:24:40.443451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 299/554] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:24:40 2022] DELETE /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:24:40.451734 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:40.452378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:40.458684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.459049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.459831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.460294 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.601844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:40.610269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eb0fc812-df8d-4e48-b7ec-c75bb5fffb70 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1502 microversion: 2.1 time: 0.162459 Jun 02 13:24:40.610843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 256/555] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:40 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:40.659530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:40.660266 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:40.666251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.666695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.667454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:40.667896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:40.798197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:40.806186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-756ac46a-412f-46af-987c-5c91d80af72c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.150879 Jun 02 13:24:40.806748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 300/556] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:40 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:41.217175 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:41.217780 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:41.224370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.224816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.225571 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.226003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.356855 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:41.364728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:41.366230 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:41.368335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b369e44-36c1-4378-9a8e-1b49e18d390f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.155033 Jun 02 13:24:41.368335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 257/557] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:41 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:41.629545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:41.630149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:41.636831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.637277 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.638048 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.639093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.772747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:41.780392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aafe14d8-ab7c-4470-a2b2-b08eb22eaed2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1502 microversion: 2.1 time: 0.154685 Jun 02 13:24:41.780964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 301/558] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:41 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:41.822545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:41.823156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:41.829223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.829673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.830438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:41.830883 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:41.959897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:41.968886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-308bf666-94f0-462a-b24b-f77daed18e78 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.149966 Jun 02 13:24:41.969397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 258/559] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:41 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:42.386328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:42.386934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:42.393519 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.393975 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:42.394954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.395404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:42.543708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:42.552451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:42.554327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:42.555827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-29e717f3-c9d5-4045-aeb3-bcbfcac08ac1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.173409 Jun 02 13:24:42.556452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 302/560] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:42 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:42.797375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:42.797984 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:42.804642 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.805088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:42.805876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.806313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:42.937288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:42.944681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-969b0ae2-6365-4416-b0c6-670f5b10fe9d tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1502 microversion: 2.1 time: 0.151181 Jun 02 13:24:42.945239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 259/561] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:42 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:42.986647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:42.987985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:42.994700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.995142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:42.995926 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:42.996363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.235720 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:43.244054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0dd83bb5-559e-450d-8450-5aecb6ebdaf9 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.261246 Jun 02 13:24:43.244647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 303/562] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:42 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:43.577816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:43.578551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:43.586592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.587346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.589572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.590648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.599906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-caad0cd3-c998-43fa-b769-0797ad0bdd97 req-825ba9d2-0a1b-4299-b0c2-b74df864c495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556133a-aaed-4159-8e00-b3c9bf87fb71", "name": "network-vif-deleted", "tag": "e6a0135a-6286-452e-b500-b917af8ca425"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:43.614528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-caad0cd3-c998-43fa-b769-0797ad0bdd97 req-825ba9d2-0a1b-4299-b0c2-b74df864c495 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.615249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-caad0cd3-c998-43fa-b769-0797ad0bdd97 req-825ba9d2-0a1b-4299-b0c2-b74df864c495 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.631085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-caad0cd3-c998-43fa-b769-0797ad0bdd97 req-825ba9d2-0a1b-4299-b0c2-b74df864c495 service nova] Creating event network-vif-deleted:e6a0135a-6286-452e-b500-b917af8ca425 for instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 on hv-cinder-79760 Jun 02 13:24:43.636773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-caad0cd3-c998-43fa-b769-0797ad0bdd97 req-825ba9d2-0a1b-4299-b0c2-b74df864c495 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Jun 02 13:24:43.637731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 304/563] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:43.647042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8afbc1a8-ffef-45d8-b8d2-3224b8568ca5", "device": "/dev/sdb"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:43.649014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:43.656500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.664154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.664154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.664154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.765986 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:43.774027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:43.775532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:43.776724 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b7a83cba-6398-4244-b6b4-85ac683d0bcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.202875 Jun 02 13:24:43.777285 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 260/564] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:43 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:43.787100 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:43.787100 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:43.789103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.789551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.790320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.790759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.928473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:43.938027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d8d29a9f-78fc-41e1-a136-7ab51e2d4dde tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1593 microversion: 2.1 time: 0.159708 Jun 02 13:24:43.938614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 261/565] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:43 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:43.962286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:43.963164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:43.971931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.971931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:43.976019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:43.976019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.011120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:44.011558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.012304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lazy-loading 'fault' on Instance uuid 0556133a-aaed-4159-8e00-b3c9bf87fb71 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:24:44.059156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022e761cfc694697b0ef9886025abc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e983852747461b8ca663cd6ff56ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:44.062797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:44.067367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ff035eee-3ee8-4d87-9967-5d0f545d33e2 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 200 len: 1303 microversion: 2.1 time: 0.109866 Jun 02 13:24:44.068341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 262/566] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:43 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:44.261695 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:44.262301 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:44.266370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=88 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:44.270613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:44.271465 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.272286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:44.272719 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.417672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:44.426099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c74183c2-2e24-466b-9b25-65f631843330 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.168303 Jun 02 13:24:44.426933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 263/567] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:44 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:44.518789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a8c6211f-64ef-4c95-9e5d-54d6a49e7213 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "POST /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879221 Jun 02 13:24:44.519439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 305/568] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:24:43 2022] POST /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:44.795528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:44.796162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:44.802367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:44.802813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.803571 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:44.804030 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:44.938536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:44.946778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:44.948357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:44.949514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3297226e-a3fe-4ac0-8ec2-9f13c32ae80b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.158890 Jun 02 13:24:44.950075 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 264/569] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:44 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:45.085890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:45.090495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] [instance: 0556133a-aaed-4159-8e00-b3c9bf87fb71] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:45.094216 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.094672 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:45.095426 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.095854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:45.100052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:45.110071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] HTTP exception thrown: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Request method failure captured: Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 HTTP/1.1 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLnIa21ydoxBtTK0a4b_K9AinthgA1-BQjSa3y--sbZFJ6msmNIJE_QLcRa6ElaZrIyUF6wnOsQQT6D4h7rP0DwNbiVnNxhfJoe3xcfR8-FGJhSJC31ACXZi0vWZCSME2F0xV6n_7kYyZG8hdzT34mpjl0qZE4jsylEwTzuXF6r32WI Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: d8e983852747461b8ca663cd6ff56ff4 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesActionsTest-550368238 Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:24:45.111725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d8e983852747461b8ca663cd6ff56ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d8e983852747461b8ca663cd6ff56ff4"}]}] Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesActionsTest-550368238 Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: d8e983852747461b8ca663cd6ff56ff4 Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesActionsTest-550368238 Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesActionsTest-550368238-project Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 022e761cfc694697b0ef9886025abc5e Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesActionsTest-550368238-project Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. Jun 02 13:24:45.113554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '0556133a-aaed-4159-8e00-b3c9bf87fb71'} Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:24:45.114325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. Jun 02 13:24:45.116528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:24:45.117685 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] Returning 404 to user: Instance 0556133a-aaed-4159-8e00-b3c9bf87fb71 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:24:45.117685 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8af179c-13ab-494c-85a7-d9fb21742429 tempest-VolumesActionsTest-550368238 tempest-VolumesActionsTest-550368238-project] 10.222.0.46 "GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71" status: 404 len: 111 microversion: 2.1 time: 0.031764 Jun 02 13:24:45.117685 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 306/570] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:45 2022] GET /compute/v2.1/servers/0556133a-aaed-4159-8e00-b3c9bf87fb71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:24:45.444939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:45.445550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:45.456395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.456395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:45.456395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.456395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:45.601896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:45.611426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ea6b985c-77e3-4507-b92d-6cf471d9b711 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.170434 Jun 02 13:24:45.621090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 265/571] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:45 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:45.968535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:45.969123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:45.976350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.976993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:45.977941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:45.978532 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:46.212001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:46.222513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:46.224221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:46.225399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-35518d71-b0ac-4923-b3ae-6728ce5bc7ea tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.261251 Jun 02 13:24:46.225958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 307/572] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:45 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:46.467759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-26d3af0c-0176-401f-95af-b8bbe5d93e46 req-eece129b-78c2-4598-847c-117eecbea440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:46.477162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-26d3af0c-0176-401f-95af-b8bbe5d93e46 req-eece129b-78c2-4598-847c-117eecbea440 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:46.477603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-26d3af0c-0176-401f-95af-b8bbe5d93e46 req-eece129b-78c2-4598-847c-117eecbea440 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:46.490133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-26d3af0c-0176-401f-95af-b8bbe5d93e46 req-eece129b-78c2-4598-847c-117eecbea440 service nova] Creating event network-changed:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:24:46.495230 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-26d3af0c-0176-401f-95af-b8bbe5d93e46 req-eece129b-78c2-4598-847c-117eecbea440 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031153 Jun 02 13:24:46.495832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 266/573] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:46.629695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:46.630319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:46.636852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:46.637300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:46.638282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:46.638718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:46.847627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:46.856259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0f1c85b4-cc5c-4018-9229-bc8da2c28565 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.230585 Jun 02 13:24:46.857556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 308/574] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:46 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:47.243474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:47.248436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:47.254896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:47.254896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:47.254896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:47.254896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:47.417160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:47.428687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:47.431751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:47.431751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ef761b6c-c670-49b4-b309-6694eeea2fae tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.192509 Jun 02 13:24:47.432311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 267/575] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:47 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:47.874761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:47.875714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:47.882750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:47.883211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:47.884022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:47.884464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:48.016900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:48.024952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2b532ebe-6352-4899-a0ee-ec68d61f918c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.154134 Jun 02 13:24:48.025529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 309/576] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:47 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:48.449773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:48.450403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:48.457246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:48.457696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:48.458473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:48.458906 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:48.651696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:48.659685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:48.661219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:48.662369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e1c05b7c-2985-45b8-8fce-200f482f896d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.216781 Jun 02 13:24:48.662926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 268/577] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:48 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:48.784602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2034781198"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:48.785135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:48.791214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:48.791837 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:48.792489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:48.792917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:48.925928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.network.security_group_api [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Adding security group 406aeda2-0e63-436e-8511-456215fb40c9 to port 9e20201d-c908-4fe2-b7fc-b6260847a07e Jun 02 13:24:49.042758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:49.043769 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:49.050152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.050599 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.051376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.051815 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.183983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:49.188742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae7fa175-a58f-4db1-b413-a79370665f71 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.149775 Jun 02 13:24:49.189494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 269/578] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:49 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:24:49.426875 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-816648df-8358-4b05-8cd9-dd953cc74055 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action" status: 202 len: 0 microversion: 2.1 time: 0.646152 Jun 02 13:24:49.430773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 310/579] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:24:48 2022] POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:24:49.438677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e9f01890-31f0-43d2-8e54-8d728c081d0c req-c9a86874-84d4-4d95-82d3-10a075de43dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:49.444159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:49.444159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:49.448664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e9f01890-31f0-43d2-8e54-8d728c081d0c req-c9a86874-84d4-4d95-82d3-10a075de43dc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.449105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e9f01890-31f0-43d2-8e54-8d728c081d0c req-c9a86874-84d4-4d95-82d3-10a075de43dc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.455749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.456840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.456969 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.457396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.463693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e9f01890-31f0-43d2-8e54-8d728c081d0c req-c9a86874-84d4-4d95-82d3-10a075de43dc service nova] Creating event network-changed:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:24:49.467975 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e9f01890-31f0-43d2-8e54-8d728c081d0c req-c9a86874-84d4-4d95-82d3-10a075de43dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Jun 02 13:24:49.468584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 311/580] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:24:49.622293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:49.630413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-76006774-3cc3-4c54-8bab-cf5df8f49670 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1759 microversion: 2.1 time: 0.191344 Jun 02 13:24:49.630983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 270/581] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:49 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:49.681012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:49.681747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:49.688019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.688416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.689174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:49.689608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:49.829255 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:49.838024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:49.839523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:49.840801 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5b841ecb-9a94-403c-9f6a-60b0eeb22caf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.164007 Jun 02 13:24:49.841910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 312/582] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:49 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:50.207215 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:50.207822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:50.214447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:50.214891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:50.215659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:50.216123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:50.348000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:50.361776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-094d36ba-01e5-4a8d-97bb-919322aaf41a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.158386 Jun 02 13:24:50.362381 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 271/583] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:50 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:50.860229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:50.860836 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:50.867457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:50.867934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:50.868693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:50.869121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:50.996079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:51.004882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:51.006383 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:51.007542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e637a041-c70d-49f8-b804-d37481f4196e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.151837 Jun 02 13:24:51.008131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 313/584] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:50 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:51.379061 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:51.379660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:51.386704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:51.387142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:51.387934 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:51.388431 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:51.521040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:51.531207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-19b2fb91-f132-42df-961c-c952bec584c8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.155998 Jun 02 13:24:51.531788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 272/585] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:51 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:52.025626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:52.026259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:52.032920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:52.033367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:52.034132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:52.034559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:52.171051 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:52.179619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:52.181319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:52.182716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-242952ad-529a-480e-a10c-af8bae00e045 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.161060 Jun 02 13:24:52.188381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 314/586] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:52 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:52.549373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:52.549973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:52.556650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:52.557090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:52.557842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:52.558274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:52.695898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:52.703891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6138c524-6d7b-499e-b2cc-e55f17e7ba3d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.158369 Jun 02 13:24:52.704448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 273/587] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:52 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:53.202054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:53.202677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:53.209785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:53.210321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:53.211349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:53.212060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:53.395805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:53.407292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:53.408963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:53.410408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-26d606fa-76fd-48f8-80c2-ab51a08c464d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.212917 Jun 02 13:24:53.421744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 315/588] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:53 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:53.722655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:53.724222 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:53.731779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:53.732379 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:53.733431 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:53.734063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:53.910509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:53.921291 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9a7aed5e-557c-4c56-a098-86b916d108dd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1723 microversion: 2.1 time: 0.202494 Jun 02 13:24:53.922624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 274/589] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:53 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:54.435469 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:54.436941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:54.453478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:54.454225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:54.455208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:54.455644 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:54.729417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:54.739629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:54.741339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:54.754584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ada1c6fe-c5ba-4e67-9340-57aec8c607e5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.311978 Jun 02 13:24:54.754584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 316/590] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:54 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:24:54.941799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:54.942723 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:54.954563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:54.955828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:54.957462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:54.958629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:55.125628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:55.134032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46eaefc8-549b-434b-93c4-81c9eb8d52b3 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1700 microversion: 2.1 time: 0.197480 Jun 02 13:24:55.146520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 275/591] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:54 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1700 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:55.151452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ca00758c-2a08-4aeb-af54-7beb8f492571 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:24:55.158365 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca00758c-2a08-4aeb-af54-7beb8f492571 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:55.158820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca00758c-2a08-4aeb-af54-7beb8f492571 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:55.223311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ca00758c-2a08-4aeb-af54-7beb8f492571 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Going to try to start instance {{(pid=118132) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 13:24:55.420281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ca00758c-2a08-4aeb-af54-7beb8f492571 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action" status: 202 len: 0 microversion: 2.1 time: 0.271214 Jun 02 13:24:55.421023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 317/592] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:24:55 2022] POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:24:55.430907 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:55.431981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:55.438848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:55.439902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:55.441084 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:55.441831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:55.666438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:55.680043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4211bd4d-d10d-42f9-8bbf-d4efddb20121 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.253428 Jun 02 13:24:55.681738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 276/593] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:55 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:55.762987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:55.764918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:55.776292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:55.779269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:55.781241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:55.784119 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:56.024769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:56.033533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:56.047680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:56.047680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2ff80fb5-cd25-4fa4-a54b-f5c88b72989c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.278141 Jun 02 13:24:56.049686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 318/594] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:55 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:56.709693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:56.711862 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:56.722814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:56.724035 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:56.725067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:56.725614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:56.883837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:56.895543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0272ff8c-ba48-4c93-87f3-65b3e0e8c5a1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.192395 Jun 02 13:24:56.896541 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 277/595] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:56 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:57.055852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:57.057538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:57.068024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:57.068886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:57.070563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:57.071169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:57.236634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:57.248669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:57.251128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:57.252936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-08e91d48-949c-4ca1-bc3f-4e968bcb94c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.202144 Jun 02 13:24:57.256152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 319/596] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:57 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:57.917506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:57.918323 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:57.928207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:57.928708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:57.929552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:57.930207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:58.096371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:58.105454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aaa6c235-a4fd-44ef-a243-12bdc6adf426 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.194904 Jun 02 13:24:58.106034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 278/597] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:57 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:58.275810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:58.276549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:58.279073 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:58.284224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:58.284681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:58.285597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:58.286222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:58.441396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:58.451622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:58.453569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:58.454987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aeaa92b2-6f8f-412c-a429-8c8c9e3ffd76 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.183368 Jun 02 13:24:58.456083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 320/598] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:58 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:24:59.124451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:59.125171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:59.131703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:59.132262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:59.133028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:59.133447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:59.268478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:59.280370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fa5c687c-38f7-44e2-ba61-cacf7723d422 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.156649 Jun 02 13:24:59.281780 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 279/599] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:24:59 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:24:59.473677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:24:59.475148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:24:59.482131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:59.482745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:59.483810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:24:59.484355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:24:59.639142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:59.648798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:59.650547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:24:59.651904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4bc45473-7507-42ac-9391-44e77d7932c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.182386 Jun 02 13:24:59.652931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 321/600] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:24:59 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:00.302089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:00.304019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:00.316839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:00.317955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:00.319252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:00.319976 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:00.327932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:00.499805 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:00.508881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-677464f1-8b55-4dc0-b1f7-43d19a259062 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.213901 Jun 02 13:25:00.523526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 280/601] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:00 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:00.671898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:00.673213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:00.680969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:00.682090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:00.683191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:00.683620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:00.860056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:00.868806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:00.870331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:00.871580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e80823e-aacb-41b5-91e9-609ef5f15849 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.204466 Jun 02 13:25:00.883899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 322/602] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:00 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:01.540656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:01.542178 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:01.551540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:01.553561 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:01.556137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:01.557121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:01.595188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2c129318-e31a-4caa-a74e-205c0e18d817 req-26e7f0c0-2a10-4619-9bfd-ead59629f2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "name": "network-vif-plugged", "status": "completed", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:01.611930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2c129318-e31a-4caa-a74e-205c0e18d817 req-26e7f0c0-2a10-4619-9bfd-ead59629f2ac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:01.611930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2c129318-e31a-4caa-a74e-205c0e18d817 req-26e7f0c0-2a10-4619-9bfd-ead59629f2ac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:01.652743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2c129318-e31a-4caa-a74e-205c0e18d817 req-26e7f0c0-2a10-4619-9bfd-ead59629f2ac service nova] Creating event network-vif-plugged:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:25:01.684407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2c129318-e31a-4caa-a74e-205c0e18d817 req-26e7f0c0-2a10-4619-9bfd-ead59629f2ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085031 Jun 02 13:25:01.685525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 323/603] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:25:01.778330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:01.788229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-52a4e747-635f-409c-8312-8eab4f1109bf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.255191 Jun 02 13:25:01.789221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 281/604] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:01 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:01.894363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:01.895399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:01.904960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:01.905289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:01.906057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:01.906485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:01.910826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:02.071316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:02.086140 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:02.088681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:02.090411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c4e965a8-f064-467a-8265-456364542064 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.200853 Jun 02 13:25:02.092232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 324/605] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:01 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:02.806455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:02.807814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:02.814964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:02.815635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:02.816613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:02.817198 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:02.960494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:02.972265 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b437ca07-b753-439c-bc73-6ba18099af0b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.169616 Jun 02 13:25:02.973112 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 282/606] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:02 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:03.111158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:03.111808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:03.118683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:03.119084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:03.119994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:03.120423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:03.296206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:03.305015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:03.306881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:03.308138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cf28ce94-d5bb-4cb2-aef6-06086d988c37 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.201234 Jun 02 13:25:03.308950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 325/607] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:03 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:03.993317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:03.995214 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:04.004304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:04.005452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:04.006960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:04.008193 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:04.190792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:04.205768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dfc6e99a-bb92-480e-b11f-e631c092eb60 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.217408 Jun 02 13:25:04.219729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 283/608] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:03 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:04.329058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:04.329828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:04.339472 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:04.340018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:04.341584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:04.342173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:04.527638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:04.537816 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:04.539526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:04.540967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b2ce334b-97fe-4b00-9455-092ed1d19f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.218144 Jun 02 13:25:04.542061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 326/609] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:04 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:05.224603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:05.225878 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:05.234890 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:05.235697 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:05.236700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:05.237310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:05.445902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:05.459144 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6c6ddc06-fb7b-4df6-93e4-6ab938909084 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1709 microversion: 2.1 time: 0.238857 Jun 02 13:25:05.460694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 284/610] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:05 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:05.564175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:05.565535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:05.573497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:05.578082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:05.578082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:05.578082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:05.749694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:05.758154 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:05.760421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:05.761794 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a7b79d5f-5d1c-4e3f-8473-2569da13d703 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.202620 Jun 02 13:25:05.762615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 327/611] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:05 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:06.478994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:06.479788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:06.487563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:06.488181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:06.489130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:06.489782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:06.672873 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:06.682665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-552531f9-29f4-4186-b637-4ab738f8fc8e tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1713 microversion: 2.1 time: 0.207821 Jun 02 13:25:06.697939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 285/612] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:06 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1713 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:06.783531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:06.784638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:06.798087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:06.802755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:06.802755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:06.802755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:06.948270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:06.957495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:06.959020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:06.960180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f2fb30fa-5765-4e27-9dad-68a033653ab6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.183033 Jun 02 13:25:06.961484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 328/613] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:06 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:07.978079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:07.978689 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:07.986160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:07.986625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:07.987522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:07.988019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:08.133343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:08.145171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:08.147166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:08.148627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ebc52c06-85ed-43d3-9757-bfc9d3ae2281 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.174551 Jun 02 13:25:08.159199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 286/614] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:07 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:09.166578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:09.167168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:09.174357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:09.174796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:09.175549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:09.176008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:09.305296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:09.313644 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:09.315128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:09.316287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9b28eaa4-b5ed-447c-a8cf-a83181cb692d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.153593 Jun 02 13:25:09.316857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 329/615] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:09 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:10.334351 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:10.334963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:10.341506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:10.341954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:10.342707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:10.343142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:10.473811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:10.482620 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:10.484293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:10.485457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1eaaaf18-8255-4740-94e7-165613b9c546 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1747 microversion: 2.20 time: 0.155071 Jun 02 13:25:10.486017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 287/616] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:10 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:11.503490 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:11.504205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:11.511110 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:11.513923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:11.513923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:11.513923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:11.644570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:11.652507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:11.653958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:11.655116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fdf167c2-0968-4d05-a414-ca74c0bd43b6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.155870 Jun 02 13:25:11.655671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 330/617] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:11 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:12.673949 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:12.675297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:12.682291 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:12.683030 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:12.683853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:12.684640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:12.843651 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:12.852077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:12.853602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:12.854768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-263f7d3b-d083-4819-a7bf-dfcf0fdc6398 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.184834 Jun 02 13:25:12.855354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 288/618] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:12 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:13.873867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:13.876452 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:13.884183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:13.884937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:13.885718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:13.886156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:14.057227 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:14.076539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:14.078217 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:14.079454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-02587172-eda4-49a8-b323-1323b898bb81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.210092 Jun 02 13:25:14.090349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 331/619] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:13 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:15.106730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:15.109708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:15.116429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=52 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:15.117978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:15.118636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:15.119889 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:15.120484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:15.262555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:15.270959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:15.272486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:15.273632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3dca5562-8161-4cf7-b251-a75265ebfb78 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.177679 Jun 02 13:25:15.274196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 289/620] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:15 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:16.292202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:16.292985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:16.300134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:16.300616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:16.301389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:16.301824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:16.661346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:16.676180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:16.677999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:16.679162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-95f64423-7447-4dd3-a93e-4d7a9a305a1b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.391209 Jun 02 13:25:16.679705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 332/621] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:16 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:17.698369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:17.698973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:17.706953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:17.707550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:17.708520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:17.709456 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:17.917412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:17.929937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:17.932804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:17.932804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-770c4c2b-d285-4f2d-9d04-49ecbab33180 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.238420 Jun 02 13:25:17.943581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 290/622] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:17 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:18.952009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:18.952628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:18.959173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:18.959612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:18.960394 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:18.960916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:19.097153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:19.105849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:19.107954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:19.109304 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-092ecddf-b6f1-47a1-876d-96eb48e37451 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.161926 Jun 02 13:25:19.109869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 333/623] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:18 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:20.128283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:20.129755 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:20.141052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:20.141513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:20.142309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:20.142747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:20.351826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:20.362806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:20.364335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:20.365503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0ae022d0-795c-4acc-9e4a-f433abd25bf5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.241526 Jun 02 13:25:20.366066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 291/624] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:20 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:21.383918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:21.385275 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:21.392604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:21.393189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:21.394225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:21.395191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:21.655421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:21.668107 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:21.670206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:21.673203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-389a457d-231d-46f7-b252-e804760a1002 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.293319 Jun 02 13:25:21.675666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 334/625] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:21 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:22.693283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:22.693893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:22.701408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:22.701863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:22.702655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:22.703051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:22.835130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:22.843860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:22.845316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:22.846517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-75f5cba5-6d90-4768-97f3-e6214166fd77 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.157206 Jun 02 13:25:22.847081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 292/626] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:22 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:23.431152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:23.432773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:23.444312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:23.445131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:23.446124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:23.446898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:23.608633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lazy-loading 'services' on Instance uuid a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:25:23.864733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:23.865337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:23.871835 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:23.876497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:23.876497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:23.876497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:23.923119 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e70a9481-f560-45cf-9eab-f8e150b3460e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8/os-volume_attachments/8afbc1a8-ffef-45d8-b8d2-3224b8568ca5" status: 202 len: 0 microversion: 2.1 time: 0.496327 Jun 02 13:25:23.923849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 335/627] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:25:23 2022] DELETE /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8/os-volume_attachments/8afbc1a8-ffef-45d8-b8d2-3224b8568ca5 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:25:24.012311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:24.021347 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:24.022862 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:24.024163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1a541d9f-aed7-4064-bedd-96db9469f7d9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.163542 Jun 02 13:25:24.024726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 293/628] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:23 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:25.044481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:25.045173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:25.051389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:25.051830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:25.052611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:25.053041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:25.187596 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:25.195984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:25.197612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:25.198896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1bcaba14-8ad0-4f3e-bf0f-177ee841b5ba tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1742 microversion: 2.20 time: 0.160056 Jun 02 13:25:25.199508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 336/629] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:25 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:26.108278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:26.108881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:26.116420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.116871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.117664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.118129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.147554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:25:26.218698 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:26.219288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:26.225739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.226181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.226942 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.227371 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.437662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:26.453310 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:26.456548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:26.457688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ac46ef6f-9c88-4fdd-8ea2-5b6ddffb7332 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1724 microversion: 2.20 time: 0.244339 Jun 02 13:25:26.458456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 337/630] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:26 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:26.471973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-da814f6e-ccb7-42ce-8449-c30febcf80e1 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 204 len: 0 microversion: 2.1 time: 0.367974 Jun 02 13:25:26.472523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 294/631] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:25:26 2022] DELETE /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:26.485867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:26.486302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:26.492789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.493342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.494144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:26.494577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:26.629530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:26.636970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2f14eada-cfbc-445a-aa71-f3ee83cc478f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1515 microversion: 2.1 time: 0.155283 Jun 02 13:25:26.637533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 338/632] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:26 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:27.478184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:27.478883 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:27.485626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:27.486057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:27.486816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:27.487242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:27.502181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:27.615417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:27.624021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:27.625502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:27.626649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-35c70330-b30a-419c-8614-9b4558dc7a46 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1724 microversion: 2.20 time: 0.153196 Jun 02 13:25:27.627202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 295/633] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:27 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:27.655003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:27.655608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:27.661868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:27.662322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:27.663089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:27.663504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:27.796253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:27.803736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c8a5c986-277e-4008-967e-e1b13c06d9f0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1515 microversion: 2.1 time: 0.153287 Jun 02 13:25:27.804332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 339/634] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:27 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:28.644984 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:28.645588 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:28.652683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:28.653150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:28.654419 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:28.654850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:28.793750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:28.802674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:28.804195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:28.805380 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0f197c26-ba28-4c75-aab9-0b1d3ef8b4f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1724 microversion: 2.20 time: 0.164817 Jun 02 13:25:28.805938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 296/635] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:28 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:28.820985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:28.821598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:28.824032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=40 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.828815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:28.833599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:28.833599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:28.833599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:28.834428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.965111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:28.973093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cdbdca6a-460e-4129-a1cf-4d3465226884 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1515 microversion: 2.1 time: 0.155935 Jun 02 13:25:28.973660 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 340/636] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:28 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:29.637054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-22df4f96-83cc-4c9a-8802-693457a631cf req-71ae036a-d9a3-46ea-a28a-5184c5507b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "name": "network-vif-unplugged", "status": "completed", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:29.646706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-22df4f96-83cc-4c9a-8802-693457a631cf req-71ae036a-d9a3-46ea-a28a-5184c5507b89 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:29.650748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-22df4f96-83cc-4c9a-8802-693457a631cf req-71ae036a-d9a3-46ea-a28a-5184c5507b89 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:29.659148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-22df4f96-83cc-4c9a-8802-693457a631cf req-71ae036a-d9a3-46ea-a28a-5184c5507b89 service nova] Creating event network-vif-unplugged:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:25:29.664183 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-22df4f96-83cc-4c9a-8802-693457a631cf req-71ae036a-d9a3-46ea-a28a-5184c5507b89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031453 Jun 02 13:25:29.664941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 297/637] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:25:29.823152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:29.824094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:29.832922 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:29.834291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:29.834438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:29.835059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:29.990461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:29.991160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:29.998057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:29.998505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:29.999257 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:29.999687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:30.037533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:30.046242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:30.047751 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:30.048952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a73031f-446d-40e3-b963-f7b84c3b5c2e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1724 microversion: 2.20 time: 0.230297 Jun 02 13:25:30.049510 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 341/638] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:29 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:30.134467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:30.142316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07585818-8598-4918-87d8-c265d608d6ff tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1515 microversion: 2.1 time: 0.156118 Jun 02 13:25:30.142893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 298/639] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:29 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:30.290100 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-c3b60457-605c-4b27-9d65-0b99fb0560db req-d28e5ed9-a617-46ae-89a6-5478d0c4af7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e727ae-ed6d-4ffa-9ff6-15720b19cab8", "name": "network-vif-deleted", "tag": "5ce65711-1669-4da7-af73-7be574b09260"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:30.298906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-c3b60457-605c-4b27-9d65-0b99fb0560db req-d28e5ed9-a617-46ae-89a6-5478d0c4af7c service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:30.299366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-c3b60457-605c-4b27-9d65-0b99fb0560db req-d28e5ed9-a617-46ae-89a6-5478d0c4af7c service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:30.310088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-c3b60457-605c-4b27-9d65-0b99fb0560db req-d28e5ed9-a617-46ae-89a6-5478d0c4af7c service nova] Creating event network-vif-deleted:5ce65711-1669-4da7-af73-7be574b09260 for instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 on hv-cinder-79760 Jun 02 13:25:30.315012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-c3b60457-605c-4b27-9d65-0b99fb0560db req-d28e5ed9-a617-46ae-89a6-5478d0c4af7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028493 Jun 02 13:25:30.316337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 342/640] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:25:31.159671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:31.160392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:31.166562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.167006 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.167768 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.170001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.219674 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.220271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.220780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lazy-loading 'fault' on Instance uuid a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:25:31.253345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:31.266296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:31.266296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.266296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.266296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.266707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.303542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:31.309334 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f9499d08-450d-4cc1-89cc-e2ec3080e631 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 200 len: 1309 microversion: 2.1 time: 0.154144 Jun 02 13:25:31.309955 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 343/641] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:31 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:31.351719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:25:31.351990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:25:31.424957 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:31.433025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:31.434522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:31.435732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-856bc625-bddd-40d1-ac37-ee2b1025cdc8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1667 microversion: 2.20 time: 0.372322 Jun 02 13:25:31.436330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 299/642] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:31 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1667 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:31.454171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4f2603-f4d9-4038-9454-db319f091470"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:31.455211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:31.461282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.461722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:31.462465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:31.463183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:32.325846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:32.326460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: a1e727ae-ed6d-4ffa-9ff6-15720b19cab8] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:32.333032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:32.333478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:32.334226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:32.334660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:32.348509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] HTTP exception thrown: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Request method failure captured: Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 HTTP/1.1 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLnIFpkHGeqDMat7V71RcUWsd0UnOzROfiUGZwZxKtdSBLAH3zrsa7Clg8wj4vIICx5PJRiMAVvLt2I2z8JOWdHJTuTboOa6KJpnWjoFYTwKQQUZQ74zym_NrY9hDBVjV1V5P2gMHokiO6vxuryxwK_4wiwY57w9xy4Alo-XYsPPrRc Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 8522fa2a30e440b890516e350e17de14 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:25:32.354439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8522fa2a30e440b890516e350e17de14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8522fa2a30e440b890516e350e17de14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8522fa2a30e440b890516e350e17de14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8522fa2a30e440b890516e350e17de14"}]}] Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 8522fa2a30e440b890516e350e17de14 Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotTestJSON-381065025-project Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 2113938dc6b94ec09e70771fdf570a85 Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotTestJSON-381065025-project Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. Jun 02 13:25:32.356047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'a1e727ae-ed6d-4ffa-9ff6-15720b19cab8'} Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:25:32.357589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. Jun 02 13:25:32.359071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:25:32.360368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Returning 404 to user: Instance a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:25:32.360368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-befb475a-a431-486d-97fd-c04091c86f97 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8" status: 404 len: 111 microversion: 2.1 time: 0.029581 Jun 02 13:25:32.360368 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 300/643] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:32 2022] GET /compute/v2.1/servers/a1e727ae-ed6d-4ffa-9ff6-15720b19cab8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:25:32.929025 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e70529fb-a740-4f96-9622-f1c02929b3a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.478422 Jun 02 13:25:32.929025 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 344/644] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Jun 2 13:25:31 2022] POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments => generated 188 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:25:33.082764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:33.084658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:33.089843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:33.090287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:33.091046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:33.091533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:33.440281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0232386f-1089-4d40-a165-f02a1add14bc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/action" status: 202 len: 0 microversion: 2.20 time: 0.362224 Jun 02 13:25:33.440896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 301/645] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 2 13:25:33 2022] POST /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:33.449065 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:33.449704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:33.456350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:33.456792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:33.457555 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:33.458130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:33.597082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:33.609500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:33.611168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:33.612608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b3fc1394-d479-4e16-b81e-5f0679d673db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1753 microversion: 2.20 time: 0.167555 Jun 02 13:25:33.613298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 345/646] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:33 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:34.223442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32261d0a-1902-42b7-a6d2-7769a4ed2483"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:34.224781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:34.232314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:34.232819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:34.233586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:34.234051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:34.632010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:34.632626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:34.639797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:34.640292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:34.641069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:34.641503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:34.779093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:34.787533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:34.789066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:34.790258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-77e443d0-51ca-483b-94c5-3323e717feb6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1753 microversion: 2.20 time: 0.162269 Jun 02 13:25:34.790986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 346/647] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:34 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:35.809527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:35.810188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:35.816771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:35.817219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:35.817986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:35.818423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:35.947408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:35.956815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:35.958325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:35.959494 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1a989523-2460-4dda-a504-3a1e6df0e7e4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1753 microversion: 2.20 time: 0.154022 Jun 02 13:25:35.960312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 347/648] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:35 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:36.978458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:36.979123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:36.986304 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:36.986748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:36.987533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:36.987991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:37.120651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:37.129507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:37.132869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:37.132869 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1079823b-eab5-4e6d-8caa-909bad0c3c63 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.157641 Jun 02 13:25:37.133073 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 348/649] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:36 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:37.989853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-28cc69ca-ace4-4731-b65d-dadd0964a71c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.911004 Jun 02 13:25:37.990674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 302/650] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:25:34 2022] POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 194 bytes in 3913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:25:38.150599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:38.151206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:38.158965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:38.159407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:38.160393 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:38.160826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:38.292035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:38.300506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:38.301999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:38.303247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a9e246fd-2049-4a4d-8289-b269a12dc733 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.156735 Jun 02 13:25:38.303791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 349/651] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:38 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:39.323166 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:39.323864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:39.330824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:39.331259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:39.332126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:39.332565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:39.467124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:39.475732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:39.477271 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:39.478444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-abf35f5a-4987-4541-8e55-d6b052a5bb7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.160236 Jun 02 13:25:39.479025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 303/652] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:39 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:40.497206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:40.497954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:40.504689 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:40.505139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:40.505894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:40.506332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:40.637178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:40.646373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:40.647977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:40.649096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-11b1d667-3214-4fa3-b013-dd5ea5ee81e6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.155872 Jun 02 13:25:40.649649 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 350/653] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:40 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:41.666603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:41.667249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:41.674525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:41.681483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:41.681483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:41.681483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:41.806903 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:41.816064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:41.817565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:41.818794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-621be98d-c1bb-43ec-a94a-f9f89a3fd1a9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.156145 Jun 02 13:25:41.819470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 304/654] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:41 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:42.836651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:42.837252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:42.844554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:42.844993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:42.845744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:42.846171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:42.975580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:42.984667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:42.986301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:42.987423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6c561293-2f5a-4ec3-9119-741bcd1775fe tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.154670 Jun 02 13:25:42.988000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 351/655] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:42 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:44.005491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:44.006104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:44.013169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:44.013661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:44.014441 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:44.014853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:44.155753 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:44.161626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:44.163437 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:44.164713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b6d57dc8-8fd0-43ad-865f-6f6a25fe03da tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1755 microversion: 2.20 time: 0.163206 Jun 02 13:25:44.165389 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 305/656] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:44 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:45.183017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:45.184200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:45.191719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:45.192243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:45.193029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:45.193465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:45.335567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:45.344876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:45.349440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:45.349440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5adf19fb-45c2-405e-b265-1da154f9cf1d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.168410 Jun 02 13:25:45.349440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 352/657] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:45 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:46.366339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:46.366944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:46.373356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:46.385843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:46.385843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:46.385843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:46.509909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:46.518515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:46.520042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:46.521202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e35cf3ba-4e70-4a56-8c95-b8524f286cde tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.158739 Jun 02 13:25:46.521752 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 306/658] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:46 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:47.542442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:47.544950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:47.553923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:47.554665 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:47.555952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:47.556666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:47.687929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:47.696512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:47.698085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:47.699221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-062c8431-4dbb-4b4c-b539-7edcbdf12edf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.163471 Jun 02 13:25:47.699766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 353/659] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:47 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:48.718271 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:48.718881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:48.721395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:48.726043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:48.726484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:48.727235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:48.727663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:48.857573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:48.865954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:48.867474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:48.868659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d6948c83-3198-4848-8e70-924bdd56435e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.155082 Jun 02 13:25:48.869206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 307/660] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:48 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:49.452428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-358194634", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "networks": [{"uuid": "61c5a169-eacf-482c-a1b5-ec89c214a1aa"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:25:49.554178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] validate_networks() for [('61c5a169-eacf-482c-a1b5-ec89c214a1aa', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:25:49.889141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:49.889764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:49.897176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:49.898093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:49.898862 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:49.899522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:50.053127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:50.065192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:50.067718 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:50.069510 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fed1e969-a19d-4ff9-9779-725545dfcecf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.185369 Jun 02 13:25:50.070187 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 308/661] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:49 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:50.166932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:25:50.167346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:25:50.167810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:25:50.168257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:25:50.168664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:25:50.178763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:50.179211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:50.180037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:50.180469 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:50.202357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Getting quotas for project 8522fa2a30e440b890516e350e17de14. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:25:50.207051 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Getting quotas for user 2113938dc6b94ec09e70771fdf570a85 and project 8522fa2a30e440b890516e350e17de14. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:25:50.218964 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:25:50.221296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:25:50.397777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-492fd1a5-2f30-4a4f-9d58-6cfefd428eb2 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950203 Jun 02 13:25:50.398399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 354/662] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:25:50.412420 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-947e3ab3-7cb7-407d-bead-8c069b89dcac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:50.414000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-947e3ab3-7cb7-407d-bead-8c069b89dcac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:50.472225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-947e3ab3-7cb7-407d-bead-8c069b89dcac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:50.481630 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-947e3ab3-7cb7-407d-bead-8c069b89dcac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1218 microversion: 2.1 time: 0.075955 Jun 02 13:25:50.485098 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 309/663] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:50 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:51.088849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:51.089902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:51.102044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:51.102498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:51.103526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:51.103996 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:51.109097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.266244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:51.275015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:51.276572 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:51.277733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-30d796e7-d985-4969-b442-f578e361f80a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.193684 Jun 02 13:25:51.278290 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 355/664] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:51 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:51.499545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:51.500028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:51.508670 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:51.509158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:51.509955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:51.510402 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:51.579521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:51.588033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ce0c30cd-1191-461a-9ce4-1aed22022063 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.092370 Jun 02 13:25:51.589507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 310/665] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:51 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:52.297312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:52.297898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:52.304963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:52.305409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:52.306212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:52.306662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:52.447632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:52.457420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:52.459085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:52.460409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-da0773d7-4470-496b-b27c-5b25feb47c59 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.168061 Jun 02 13:25:52.471257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 356/666] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:52 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:52.606512 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:52.607693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:52.614573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:52.615019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:52.615777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:52.616250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:52.678469 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:52.681909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:52.686680 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cfe49540-8df1-4435-9f04-e3cb18f5a4d3 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.084026 Jun 02 13:25:52.687777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 311/667] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:52 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:53.479168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:53.479864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:53.488560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:53.489538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:53.490637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:53.491303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:53.636094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:53.644931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:53.646418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:53.647560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b48eca6c-bb17-42dc-b979-f84b02a54ef5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.172822 Jun 02 13:25:53.648144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 357/668] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:53 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:53.714253 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:53.715513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:53.722827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:53.723268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:53.724057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:53.724486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:53.789468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:53.793791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9ad01a6b-677d-4235-8634-0735a2f6ac98 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.086612 Jun 02 13:25:53.794861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 312/669] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:53 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:54.665493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:54.666080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:54.673591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:54.674056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:54.674853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:54.675436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:54.810642 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:54.811352 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:54.819684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:54.820158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:54.820936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:54.821375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:54.827454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:54.836546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:54.838397 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:54.840016 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-60484404-6b1b-445a-8f26-ce8b68697b4f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.178425 Jun 02 13:25:54.852161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 358/670] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:54 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:54.888577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:54.896056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cd05a37b-1577-4ae9-b764-91e719f7a43e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.089292 Jun 02 13:25:54.896618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 313/671] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:54 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:55.861749 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:55.863033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:55.870168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:55.870565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:55.871340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:55.871810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:55.912946 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:55.913591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:55.920891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:55.921336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:55.922101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:55.922536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:55.993388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:56.004821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a7657b21-f98a-4314-83db-2bdc5d705a77 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.095603 Jun 02 13:25:56.012032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 314/672] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:55 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:56.031667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:56.040521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:56.042018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:56.043200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-53978999-4c4d-4ac7-aa75-b5b6c81a82b9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.186291 Jun 02 13:25:56.043822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 359/673] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:55 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:25:57.024360 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:57.025041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:57.031813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:57.032287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:57.033052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:57.033516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:57.062074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:57.062677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:57.069252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:57.069711 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:57.070475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:57.070912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:57.098825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:57.108628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5a316572-cf3b-45e8-8799-756e43a17d0e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.089186 Jun 02 13:25:57.109540 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 315/674] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:57 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:57.211028 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:57.222301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:57.223901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:57.231418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-376a145d-8c80-45c7-864c-1bc25817e21e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.173865 Jun 02 13:25:57.232199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 360/675] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:57 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:58.125450 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:58.126097 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:58.132512 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:58.132955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:58.133699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:58.134127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:58.200056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:58.208998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-51a3e502-e755-49fc-b468-12a8d3ae609a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.087342 Jun 02 13:25:58.209570 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 316/676] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:58 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:58.248971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:58.249571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:58.255811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:58.256309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:58.257036 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:58.257481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:58.404300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:58.412376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:58.413903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:58.415034 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e5bdb73-b37f-4789-8e42-c771e1955d2d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.170059 Jun 02 13:25:58.415594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 361/677] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:58 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:25:59.227089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:59.227629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:59.235518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:59.236267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:59.237171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:59.237972 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:59.310749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:59.321951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46459231-d8e6-40dc-ab51-e2e1baae97ee tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.098705 Jun 02 13:25:59.323012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 317/678] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:25:59 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:59.435535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:25:59.436979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:25:59.444059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.446944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:59.448085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:59.449431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:25:59.450181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:25:59.611781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:59.622719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:59.624406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:25:59.625654 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c9ddd391-a989-44b9-83c2-5197a9fcb5b4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.195124 Jun 02 13:25:59.636192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 362/679] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:25:59 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:00.340255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:00.341711 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:00.348655 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:00.349394 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:00.350386 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:00.350996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:00.414671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:00.425549 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ca66787d-1f57-4ce3-9e26-f946e1488c8c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.089521 Jun 02 13:26:00.426129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 318/680] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:00 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:00.644303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:00.644884 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:00.647717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.648405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.652522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:00.652972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:00.653902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:00.654347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:00.793160 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:00.802272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:00.803795 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:00.805228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8bca914-450a-4012-8832-cbcdb1883dbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.165314 Jun 02 13:26:00.805833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 363/681] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:00 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:01.442453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:01.443070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:01.444915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:01.450267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:01.450706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:01.451453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:01.451900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:01.512296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:01.520529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5b08854e-e5aa-4285-8d06-cdf56d6dec69 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.081798 Jun 02 13:26:01.521178 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 319/682] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:01 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:01.823197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:01.823802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:01.830724 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:01.831226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:01.832084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:01.832541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:01.969423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:01.979478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:01.980995 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:01.982299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ccf2871c-b66b-485e-8d30-98659728f57a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.163084 Jun 02 13:26:01.982855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 364/683] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:01 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:02.538604 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:02.539238 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:02.545685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:02.549913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:02.549913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:02.549913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:02.607608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:02.615194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a17dca09-2c5d-4198-b4b7-7a39941d737f tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.080509 Jun 02 13:26:02.615751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 320/684] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:02 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:03.002214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:03.002806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:03.009313 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:03.009754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:03.010534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:03.010961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:03.311846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:03.320464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:03.321993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:03.323175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b7d068ba-85d5-4882-9864-a45cdd1c25ef tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.326477 Jun 02 13:26:03.323721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 365/685] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:02 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:03.633461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:03.634170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:03.641358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:03.641803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:03.642559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:03.642993 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:03.705980 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:03.713635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-deb40737-fcd3-4273-b4da-8309d4417023 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.084044 Jun 02 13:26:03.714169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 321/686] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:03 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:04.348373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:04.348949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:04.355372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:04.355826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:04.356608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:04.357043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:04.489487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:04.498395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:04.499910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:04.501070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5e93e829-df97-4eaa-a172-b66382820507 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.156718 Jun 02 13:26:04.501622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 366/687] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:04 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:04.730513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:04.731052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:04.737463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:04.737911 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:04.738662 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:04.739098 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:04.802841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:04.811017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8c69c296-38e9-49f7-b95b-eff707ffd494 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.083869 Jun 02 13:26:04.811586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 322/688] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:04 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:05.518559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:05.519164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:05.530029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:05.530488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:05.531270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:05.531704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:05.661063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:05.669338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:05.671409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:05.672693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-48775e8b-347a-4b2b-ba3e-382645c681fc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.157957 Jun 02 13:26:05.673183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 367/689] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:05 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:05.828923 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:05.829527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:05.836103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:05.836545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:05.837297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:05.837982 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:05.900887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:05.909086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d9b0693f-bebd-47c7-b6fb-b91877a8f18d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1222 microversion: 2.1 time: 0.084695 Jun 02 13:26:05.909597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 323/690] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:05 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:06.691577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:06.692205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:06.698805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:06.699245 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:06.700045 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:06.700475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:06.831666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:06.840504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:06.843408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:06.844767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-02c8e407-63e0-4c6c-bd16-a6b77fff4826 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.157073 Jun 02 13:26:06.845311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 368/691] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:06 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:06.927315 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:06.927853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:06.934292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:06.934728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:06.935489 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:06.935954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:06.999230 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:07.007510 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f0dc80f9-3a7f-467f-824c-416e78310436 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1214 microversion: 2.1 time: 0.084121 Jun 02 13:26:07.011724 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 324/692] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:06 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:07.863156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:07.863765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:07.870364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:07.870813 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:07.871564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:07.872029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:08.024831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:08.025682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:08.033127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:08.033698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:08.034885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:08.035531 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:08.073706 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:08.083709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:08.085316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:08.087000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fa9c9829-c38e-471c-b204-05b018a1f11c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.227751 Jun 02 13:26:08.088134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 369/693] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:07 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:08.115917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:08.124221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1f03b6d8-fdf3-46ce-ac69-f16c05994bac tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1288 microversion: 2.1 time: 0.103110 Jun 02 13:26:08.124794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 325/694] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:08 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:09.114774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:09.114774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:09.114774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:09.114774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:09.115481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:09.115481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:09.141094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:09.142041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:09.148931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:09.149391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:09.150147 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:09.150574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:09.290998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:09.298551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ba3cf84e-81f9-42a6-bbfb-a2b8f3fef1b5 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.161775 Jun 02 13:26:09.299122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 326/695] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:09 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:09.315937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:09.324437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:09.326558 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:09.327734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aaba4b5e-4a64-4101-82ec-4d987fb656c4 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.226574 Jun 02 13:26:09.328564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 370/696] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:09 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:09.594496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-9f269b93-6c15-466e-975a-4fcdc0b2e706 req-2654b860-0fc2-4a2c-990f-dccbb338fdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b25c17-6191-4f88-baa3-3dca3ac4e6b6", "tag": "d3a0e60d-e3de-4861-81fe-ee9345673f92"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:09.602832 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9f269b93-6c15-466e-975a-4fcdc0b2e706 req-2654b860-0fc2-4a2c-990f-dccbb338fdaa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:09.603266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9f269b93-6c15-466e-975a-4fcdc0b2e706 req-2654b860-0fc2-4a2c-990f-dccbb338fdaa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:09.614590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-9f269b93-6c15-466e-975a-4fcdc0b2e706 req-2654b860-0fc2-4a2c-990f-dccbb338fdaa service nova] Creating event network-changed:d3a0e60d-e3de-4861-81fe-ee9345673f92 for instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 on hv-cinder-79760 Jun 02 13:26:09.619677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-9f269b93-6c15-466e-975a-4fcdc0b2e706 req-2654b860-0fc2-4a2c-990f-dccbb338fdaa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085280 Jun 02 13:26:09.620317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 327/697] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:26:10.315005 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:10.315557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:10.322153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:10.322595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:10.323359 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:10.323793 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:10.348137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:10.348830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:10.354973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:10.355411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:10.356226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:10.356658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:10.456432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:10.460044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:10.465451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-94bb89dd-e44c-4b1f-b896-e02d4c2c316a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.154571 Jun 02 13:26:10.466039 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 371/698] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:10 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:10.493426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:10.501788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:10.503282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:10.504474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-de91231b-f6a5-46c0-a3f8-1fa91ed46658 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.161367 Jun 02 13:26:10.506005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 328/699] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:10 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:11.483994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:11.484518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:11.491330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:11.491814 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:11.492612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:11.493053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:11.522473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:11.523184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:11.530891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:11.531427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:11.532355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:11.532787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:11.536966 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:11.623683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:11.632020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-72ed374b-1aba-4919-ad47-ab39965f5e85 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.153065 Jun 02 13:26:11.632592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 372/700] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:11 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:11.667336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:11.675892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:11.677432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:11.678601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f510414d-b3cb-42c1-b294-a676371ca812 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.160015 Jun 02 13:26:11.679159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 329/701] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:11 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:12.648522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:12.649131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:12.655661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:12.656143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:12.656935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:12.657416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:12.695762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:12.696399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:12.703067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:12.703515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:12.704314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:12.704749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:12.788221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:12.796235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9ba95dae-634e-47c8-84fd-d37f8de4941e tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.151479 Jun 02 13:26:12.796811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 373/702] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:12 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:12.838120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:12.846765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:12.848464 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:12.849618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-55c56120-c370-4980-bca8-6c06f9931b28 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.157688 Jun 02 13:26:12.850179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 330/703] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:12 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:13.812454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:13.813061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:13.820152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:13.820593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:13.821345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:13.821776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:13.868326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:13.869154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:13.875623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:13.876105 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:13.876864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:13.877298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:13.954110 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:13.961832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-90f3e314-775f-481c-8bb2-9293025d9131 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.153333 Jun 02 13:26:13.962401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 374/704] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:13 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:14.013426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:14.022872 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:14.024390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:14.025547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2b23f2b0-181d-4fce-98e3-b708d8114964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.161117 Jun 02 13:26:14.026096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 331/705] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:13 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:14.978123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:14.978857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:14.985431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:14.989904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:14.989904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:14.989904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:15.042522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:15.043150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:15.051700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:15.052812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:15.053597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:15.054043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:15.123828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:15.131201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05906322-8250-42b0-8a56-aee9fb2e4f2b tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.156969 Jun 02 13:26:15.131852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 375/706] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:14 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:15.183619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:15.192119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:15.193618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:15.194823 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-df4b82c3-e656-49ce-b741-574b22d22380 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.156219 Jun 02 13:26:15.195377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 332/707] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:15 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:16.148151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:16.148789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:16.155909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:16.156358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:16.157125 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:16.157558 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:16.213694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:16.214415 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:16.221553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:16.222004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:16.222761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:16.223207 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:16.288947 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:16.296980 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-884b89ba-4dd3-4020-8a76-4144269c2004 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.152688 Jun 02 13:26:16.297543 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 376/708] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:16 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:16.351704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:16.360816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:16.362334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:16.363495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3e2419d0-e077-4105-b0d7-8dcb40fc4d8b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.154047 Jun 02 13:26:16.364085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 333/709] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:16 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:17.314030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:17.314690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:17.321232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:17.321684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:17.322443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:17.322882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:17.381513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:17.382119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:17.389011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:17.389386 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:17.390142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:17.390573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:17.455221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:17.464903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-04c4dd2c-668d-4c47-a733-49a719093a61 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.155079 Jun 02 13:26:17.465860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 377/710] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:17 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:17.528893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:17.538428 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:17.539954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:17.541127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b4f3f7cc-7a6f-4861-ae46-1f6ca92d14ca tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.163483 Jun 02 13:26:17.541696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 334/711] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:17 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:18.483509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:18.484141 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:18.490618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:18.491057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:18.491811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:18.492263 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:18.559035 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:18.559738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:18.566497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:18.566954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:18.567721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:18.568182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:18.620465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:18.628215 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-896dc170-65d7-4754-ab76-13f63c6aa192 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.149218 Jun 02 13:26:18.628872 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 378/712] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:18 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:18.703032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:18.711602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:18.713583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:18.714749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8670ab71-d68c-454e-85d1-f35325d47b33 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.160185 Jun 02 13:26:18.715311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 335/713] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:18 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:26:18.932939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e8f200f4-35f8-4988-8f73-3cf854805d7f req-548ca70b-daba-45f2-ac7a-c9c982995c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b25c17-6191-4f88-baa3-3dca3ac4e6b6", "name": "network-vif-plugged", "status": "completed", "tag": "d3a0e60d-e3de-4861-81fe-ee9345673f92"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:18.941374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e8f200f4-35f8-4988-8f73-3cf854805d7f req-548ca70b-daba-45f2-ac7a-c9c982995c94 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:18.941599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e8f200f4-35f8-4988-8f73-3cf854805d7f req-548ca70b-daba-45f2-ac7a-c9c982995c94 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:18.954625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e8f200f4-35f8-4988-8f73-3cf854805d7f req-548ca70b-daba-45f2-ac7a-c9c982995c94 service nova] Creating event network-vif-plugged:d3a0e60d-e3de-4861-81fe-ee9345673f92 for instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 on hv-cinder-79760 Jun 02 13:26:18.960563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e8f200f4-35f8-4988-8f73-3cf854805d7f req-548ca70b-daba-45f2-ac7a-c9c982995c94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089969 Jun 02 13:26:18.961437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 379/714] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:26:19.645726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:19.646555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:19.654859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:19.655384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:19.656363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:19.656673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:19.735895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:19.736734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:19.746631 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:19.747181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:19.748077 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:19.748582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:19.803938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:19.815324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6d4d53c0-3f73-4fc6-8d59-ce2853c76b5d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.173626 Jun 02 13:26:19.815525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 336/715] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:19 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:19.898738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:19.908587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:19.910102 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:19.911547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0233c1a3-8b16-43f8-8042-313383cae5c6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.181466 Jun 02 13:26:19.911831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 380/716] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:19 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:20.832694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:20.833316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:20.835706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=62 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:20.840747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:20.841190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:20.841947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:20.842377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:20.929587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:20.930837 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:20.937728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:20.938193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:20.939165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:20.939602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:20.977052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:20.985491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4869c768-2f5c-425d-b20e-b3a0bb379409 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.156455 Jun 02 13:26:20.986088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 337/717] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:20 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:21.084169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:21.093099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:21.095468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:21.096650 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0304852d-544d-49ef-948e-9f649669f168 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.170934 Jun 02 13:26:21.097383 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 381/718] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:20 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:21.468634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:21.469602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:21.476877 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:21.477316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:21.478070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:21.478518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:21.506170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'flavor' on Instance uuid 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:26:21.864928 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f5c9f7bb-bdaa-408f-bef2-15b6447aabd9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/action" status: 200 len: 32 microversion: 2.1 time: 0.400149 Jun 02 13:26:21.866566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 338/719] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:26:21 2022] POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:26:21.874982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:21.876224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:21.882438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:21.882882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:21.883671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:21.884130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.003557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:22.004411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:22.011201 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:22.011648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.012451 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:22.012887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.165455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:22.174040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9c72fbd0-a7be-47d8-b96e-6a7671edabcd tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1318 microversion: 2.1 time: 0.175274 Jun 02 13:26:22.174879 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 339/720] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:21 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:22.179953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:22.180750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:22.187333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:22.191611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.191611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:22.191611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.270045 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:22.278472 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8a6a59e6-ed3b-49eb-84d6-47ba74058289 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.407485 Jun 02 13:26:22.279038 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 382/721] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:21 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:22.335553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:22.347194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:22.349936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:22.351131 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e8447f4d-7513-4c70-8aa9-6ab385eca45a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.175133 Jun 02 13:26:22.351693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 340/722] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:22 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:22.821292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-0b029f7c-3e74-47ed-be55-942820cb51b5 req-f9cb13bb-c80a-4191-a43a-9bd7fec38d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "name": "network-vif-plugged", "status": "completed", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:22.831809 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-0b029f7c-3e74-47ed-be55-942820cb51b5 req-f9cb13bb-c80a-4191-a43a-9bd7fec38d63 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:22.832307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-0b029f7c-3e74-47ed-be55-942820cb51b5 req-f9cb13bb-c80a-4191-a43a-9bd7fec38d63 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:22.845063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-0b029f7c-3e74-47ed-be55-942820cb51b5 req-f9cb13bb-c80a-4191-a43a-9bd7fec38d63 service nova] Creating event network-vif-plugged:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:26:22.850233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-0b029f7c-3e74-47ed-be55-942820cb51b5 req-f9cb13bb-c80a-4191-a43a-9bd7fec38d63 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Jun 02 13:26:22.850859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 383/723] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:26:23.191203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:23.191812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:23.198426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.198870 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.199632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.200274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.297866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:23.298530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:23.304745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.309109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.309109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.309109 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.333926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:23.342360 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-33ef96b5-c248-4e60-bc6e-23e4d228e84c tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1508 microversion: 2.1 time: 0.155719 Jun 02 13:26:23.342939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 341/724] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:23 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:23.358609 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "205648fd-be86-4771-b345-deca6a4f4142", "device": "/dev/sdb"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:23.360981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:23.367382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.368121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.369139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.369788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.449164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:23.459027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e8bf79b7-d39c-4a08-bee2-8ed6d462a1f9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.166871 Jun 02 13:26:23.459688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 384/725] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:23 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:23.464465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:23.465269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:23.471113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.471551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.472325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:23.472757 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:23.705450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:23.717622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:23.719711 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:23.721134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-73efc9c0-a21b-4ceb-9f8d-c1e37c796f1c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.260506 Jun 02 13:26:23.721843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 385/726] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:23 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:24.097557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.303954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bafa1af0-9d1a-4407-996a-65c8f9aa850d tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "POST /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949057 Jun 02 13:26:24.304606 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 342/727] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:26:23 2022] POST /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:26:24.477923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:24.479157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:24.486219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:24.487044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:24.488980 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:24.489503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:24.656506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:24.665588 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-49370de6-e609-4267-8b0a-a54ae02d763b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.192218 Jun 02 13:26:24.666172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 386/728] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:24 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:24.740914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:24.741559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:24.749161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:24.749612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:24.750380 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:24.750835 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:24.892730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:24.901318 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:24.902813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:24.904062 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0dfbcb60-4c8e-409e-8891-54f8a8ce2e56 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.167600 Jun 02 13:26:24.904619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 343/729] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:24 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:25.683238 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:25.683840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:25.691142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:25.691585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:25.692373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:25.692827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:25.833866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:25.842346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-67160afa-ff73-461a-aa98-4aa8b19f7b77 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.162963 Jun 02 13:26:25.842984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 387/730] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:25 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:25.923181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:25.924056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:25.930408 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:25.930874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:25.931616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:25.932142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:26.060944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:26.074383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:26.074383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:26.074383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1362aac8-46f9-47ab-bf37-b3db8364d6bf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.154529 Jun 02 13:26:26.074708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 344/731] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:25 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:26.861990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:26.862530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:26.869163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:26.869613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:26.870385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:26.870820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:27.004653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:27.012577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d36c6feb-cdf2-4c5d-a753-c37f8658eb0a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.155797 Jun 02 13:26:27.013152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 388/732] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:26 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:27.091000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:27.091915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:27.098682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:27.099309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:27.100638 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:27.101087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:27.240715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:27.249162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:27.251219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:27.252487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-78ed1f91-6881-47fd-9ba3-c20e9f72b7e1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1811 microversion: 2.20 time: 0.165893 Jun 02 13:26:27.260041 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 345/733] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:27 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:28.031022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:28.032875 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:28.039099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:28.039799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:28.040719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:28.041089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:28.198781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:28.202508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:28.208056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aff33331-6f6c-41bd-8e53-00795b7b0ad3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.181010 Jun 02 13:26:28.208662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 389/734] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:28 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:28.271096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:28.271754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:28.278671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:28.279115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:28.279885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:28.280320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:28.423258 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:28.438954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:28.440475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:28.441669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8449809-2aa5-4a80-a66b-11527771cd85 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1798 microversion: 2.20 time: 0.175144 Jun 02 13:26:28.444887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 346/735] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:26:28 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1798 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:26:29.226553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:29.227160 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:29.233769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:29.234214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:29.235573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:29.236038 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:29.434325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:29.445542 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e02060b3-5bb9-4d67-9cda-774d0fc960c0 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.223255 Jun 02 13:26:29.446115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 390/736] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:29 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:30.463056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:30.463667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:30.471124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:30.471573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:30.472391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:30.473537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:30.615998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:30.626246 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d915dbc6-1da8-4df2-b937-c94af773e628 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.166881 Jun 02 13:26:30.626839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 347/737] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:30 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:31.643145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:31.643936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:31.646401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=58 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.651619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:31.652108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:31.652897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:31.653334 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:31.874299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:31.884127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-26767272-6f37-4b95-a48f-ced630dfb89a tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.244913 Jun 02 13:26:31.894223 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 391/738] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:31 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:32.901396 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:32.902014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:32.909573 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:32.909929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:32.910709 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:32.911465 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:33.073766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:33.082501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2908c59b-95f6-4d13-8dfc-8d0d461c76df tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.185156 Jun 02 13:26:33.083086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 348/739] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:32 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:34.101075 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:34.102831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:34.114612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:34.115147 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:34.116063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:34.116517 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:34.366916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:34.378362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-55dd4541-cc78-4ce6-b27e-a4841deade28 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.281058 Jun 02 13:26:34.379669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 392/740] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:34 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:35.400531 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:35.401297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:35.409119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:35.409854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:35.410820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:35.411262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:35.586304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:35.594688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-db5213ae-883b-4ee4-bbb4-be3f480a25ac tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.200972 Jun 02 13:26:35.595270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 349/741] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:35 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:36.612745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:36.613317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:36.624023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:36.624570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:36.625421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:36.626029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:36.772253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:36.781153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-40331891-45dd-429c-9e72-8f72c0e23d88 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.173118 Jun 02 13:26:36.781817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 393/742] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:36 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:37.799485 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:37.800145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:37.807316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:37.808268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:37.808633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:37.809073 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:38.123447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:38.149895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-99206fcd-8ff2-4b03-b960-f2b9ac76c0a5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.354737 Jun 02 13:26:38.150566 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 350/743] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:37 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:39.167354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:39.168035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:39.181281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:39.181847 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:39.182685 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:39.183121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:39.530772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:39.547058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c126c49a-1324-4a79-b8a6-e70c692c46da tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.383583 Jun 02 13:26:39.548511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 394/744] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:39 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:40.570768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:40.571460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:40.578088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:40.579044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:40.580114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:40.580764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:40.722154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:40.730586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3e1bb925-e0db-404f-91fb-916d31cf8412 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.163599 Jun 02 13:26:40.731099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 351/745] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:40 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:41.298903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1685ee25-bb42-47c8-a8b0-210cf085503f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Action: 'create', calling method: .version_select at 0x7f5a738659d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-160009625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD0iDf0vp+cvEsjPxw27cSiNDeHIulGsE+zJXwjbf53bgZ1695UnJmnF7ifBcXXUp987b7R2rCp6d6N8yrZ39L2MN/tik6X/xGed2pH9ClAQtsnjoRc22eChXHo3wTt7g=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:41.312912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-1685ee25-bb42-47c8-a8b0-210cf085503f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:26:41.316686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-1685ee25-bb42-47c8-a8b0-210cf085503f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for user 14bd9be0202b433cb1fa8be6afee8ee5 and project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:26:41.399232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1685ee25-bb42-47c8-a8b0-210cf085503f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.272886 Jun 02 13:26:41.403079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 395/746] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:26:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:26:41.751674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:41.753034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:41.760153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:41.760656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:41.762024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:41.762024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:41.956893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:41.964881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6a00e22e-e4dd-4183-8913-1b0fa678957c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.220228 Jun 02 13:26:41.965723 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 352/747] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:41 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:42.983364 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:42.991474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:42.991474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:42.991949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:42.992723 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:42.993162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:43.140041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:43.149811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d63284d5-de59-49c8-b296-f59f75036634 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.171191 Jun 02 13:26:43.159953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 396/748] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:42 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:44.166671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:44.167279 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:44.174640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:44.175094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:44.176088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:44.176524 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:44.308898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:44.317627 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ba607398-b03a-487f-8649-c72e24fec39b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.154872 Jun 02 13:26:44.318312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 353/749] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:44 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:45.335266 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:45.335891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:45.342731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:45.343179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:45.343977 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:45.344993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:45.476303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:45.484230 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-be124ec5-3574-4dcd-bc9d-7d1cc24fa7c9 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.152917 Jun 02 13:26:45.484809 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 397/750] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:45 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:46.501440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:46.502056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:46.509281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:46.509897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:46.510845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:46.511509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:46.654612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:46.663490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-72636c87-78bc-43e0-9fbd-5e9eb59cdfb7 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.165922 Jun 02 13:26:46.664094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 354/751] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:46 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:47.680967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:47.681626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:47.689381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:47.689833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:47.690621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:47.691062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:47.837013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:47.847702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2334b8b0-6ed8-4ece-81c5-6dacd8364df5 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.170582 Jun 02 13:26:47.848323 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 398/752] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:47 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:48.865373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:48.865991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:48.873031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:48.873475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:48.874244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:48.874675 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:49.012979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:49.021002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3964e5cf-d025-462f-b510-a604aac9e264 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.159476 Jun 02 13:26:49.021564 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 355/753] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:48 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:50.038074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:50.038603 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:50.045246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:50.045717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:50.046476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:50.046920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:50.181487 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:50.192213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-db055b55-23a5-4263-bfb0-ef34740db923 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.158011 Jun 02 13:26:50.192811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 399/754] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:50 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:50.927899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:50.928459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:50.935830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:50.936309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:50.937071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:50.937500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:51.064161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lazy-loading 'services' on Instance uuid e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:26:51.210594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:51.211232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:51.218437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:51.218883 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:51.220301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:51.220734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:51.323669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.346949 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d5fab0b8-6b16-44a1-a622-5cb40f2f6390 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6/os-volume_attachments/205648fd-be86-4771-b345-deca6a4f4142" status: 202 len: 0 microversion: 2.1 time: 0.424712 Jun 02 13:26:51.347584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 356/755] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:26:50 2022] DELETE /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6/os-volume_attachments/205648fd-be86-4771-b345-deca6a4f4142 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:26:51.362259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:51.370406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9c5a0eca-c9f6-4e39-8327-122e9147827c tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.163865 Jun 02 13:26:51.370984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 400/756] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:51 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:52.389176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:52.389869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:52.391891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=40 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.397912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:52.398329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:52.399101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:52.399556 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:52.542834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:52.551103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0eb78087-658e-46d3-a7d0-42783c341e8b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.166551 Jun 02 13:26:52.556452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 357/757] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:52 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:53.569299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:53.569912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:53.576825 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:53.577296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:53.578157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:53.578618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:53.725613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:53.734050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7d0bb0f8-5e20-44e8-a457-7f5d6656ae50 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.168985 Jun 02 13:26:53.735196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 401/758] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:53 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:54.751686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:54.752327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:54.758891 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:54.759335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:54.760130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:54.760567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:54.764492 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:54.895196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:54.903189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-26b8bb9d-d568-407d-a2cf-caac4c55bee1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.155326 Jun 02 13:26:54.903767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 358/759] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:54 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:55.633797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:55.634324 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:55.640957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:55.641395 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:55.642168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:55.642597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:55.670308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:26:55.924432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:55.925334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:55.942900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:55.943357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:55.944162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:55.944601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:56.014408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b6f0263-f5d4-4395-ad9f-5e583c5ad1ef tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 204 len: 0 microversion: 2.1 time: 0.384139 Jun 02 13:26:56.015257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 402/760] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:26:55 2022] DELETE /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:56.024177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:56.024986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:56.035747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:56.037079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:56.037228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:56.037739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:56.189716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:56.198061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-61de2ac2-be19-4dec-91d5-26178d669fe0 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1514 microversion: 2.1 time: 0.178342 Jun 02 13:26:56.207637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 403/761] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:56 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:56.250318 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:56.258786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9354fe27-9de4-4da8-9be1-323234ebf708 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1735 microversion: 2.1 time: 0.341352 Jun 02 13:26:56.259367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 359/762] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:55 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:57.215257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:57.215853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:57.222534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.223042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.223776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.224233 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.277264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:57.278058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:57.284647 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.285226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.287757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.288455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.366501 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:57.373932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b094e3d8-833c-49a0-8538-bf32af42cb74 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1514 microversion: 2.1 time: 0.162736 Jun 02 13:26:57.374743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 404/763] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:57 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:57.427461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:57.435697 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2263460d-a4d4-45df-9315-1f4e109b1ebe tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1715 microversion: 2.1 time: 0.162106 Jun 02 13:26:57.436288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 360/764] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:57 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:57.540625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:57.541146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:57.547824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.548301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.549064 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.549505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.630640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.634844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] HTTP exception thrown: Cannot 'detach_volume' instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 while it is in vm_state rescued Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Request method failure captured: Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments/32261d0a-1902-42b7-a6d2-7769a4ed2483 HTTP/1.1 Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkdoxQVsuRZyzeHL_NlpXhpxZTD16y94iYBpr4-Q4P-xoqoLcyjW0sf7KYmP81SO4hbITem5KItlLKF-dygpP6_kgVyU-NQoIv4pryREPefVHvFt4_AD17v51nmVfGNYCqvPyZpow125_D5S6A4h2sy3VPEf8wgHsaWJE2oimQ-ZpU Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:26:57.636535 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dd922c0d796647f8891bf4c5671e4c7b"}]}] Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 5c3f539d6d374fd8b3eaa9e3e22e5cb1 Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:26:57.638456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Cannot 'detach_volume' instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 while it is in vm_state rescued Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3', 'id': '32261d0a-1902-42b7-a6d2-7769a4ed2483'} Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:26:57.639485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 while it is in vm_state rescued Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 while it is in vm_state rescued Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:26:57.645257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Returning 409 to user: Cannot 'detach_volume' instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 while it is in vm_state rescued {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:26:57.646806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-83969bee-b235-4beb-8274-86a659d4a8a3 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments/32261d0a-1902-42b7-a6d2-7769a4ed2483" status: 409 len: 152 microversion: 2.1 time: 0.101460 Jun 02 13:26:57.646806 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 405/765] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:26:57 2022] DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments/32261d0a-1902-42b7-a6d2-7769a4ed2483 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 13:26:57.648642 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:57.649173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:57.655288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.655721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.656828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.657304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.811896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0e2b04b5-5fdf-4ba8-a579-8e098d30d668 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/action" status: 202 len: 0 microversion: 2.1 time: 0.166800 Jun 02 13:26:57.812459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 361/766] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:26:57 2022] POST /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:26:57.824797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:57.825517 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:57.833332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.833782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.834545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:57.834978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:57.966181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:57.974882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-532ef996-0f65-4292-874d-fd3ea33b2b92 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1723 microversion: 2.1 time: 0.157845 Jun 02 13:26:57.975441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 406/767] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:57 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:58.391128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:58.391836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:58.399433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:58.399935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:58.400722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:58.401162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:58.567275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:58.574848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-02909ede-8b05-4dfc-b16a-b157e0f5eb65 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1514 microversion: 2.1 time: 0.187944 Jun 02 13:26:58.575423 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 362/768] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:58 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:58.992493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:58.993174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:59.000804 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:59.002087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:59.002872 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:59.003314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:59.146948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:59.155018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1a793c64-f65c-42c0-8f0b-729623b89ae4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1723 microversion: 2.1 time: 0.166405 Jun 02 13:26:59.155582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 407/769] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:58 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:59.592286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:26:59.592897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:26:59.600226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:59.600676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:59.601432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:59.601867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:59.831530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:26:59.839380 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-04e30438-8494-4f44-a8f7-5a166621651a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1514 microversion: 2.1 time: 0.250996 Jun 02 13:26:59.839963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 363/770] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:26:59 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:59.863986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-14f41ac1-eab3-44e5-904f-d75af11ca7a8 req-233500b7-2683-452b-96e0-d65b1f24d737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b25c17-6191-4f88-baa3-3dca3ac4e6b6", "name": "network-vif-deleted", "tag": "d3a0e60d-e3de-4861-81fe-ee9345673f92"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:26:59.872091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-14f41ac1-eab3-44e5-904f-d75af11ca7a8 req-233500b7-2683-452b-96e0-d65b1f24d737 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:26:59.872527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-14f41ac1-eab3-44e5-904f-d75af11ca7a8 req-233500b7-2683-452b-96e0-d65b1f24d737 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:26:59.883155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-14f41ac1-eab3-44e5-904f-d75af11ca7a8 req-233500b7-2683-452b-96e0-d65b1f24d737 service nova] Creating event network-vif-deleted:d3a0e60d-e3de-4861-81fe-ee9345673f92 for instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 on hv-cinder-79760 Jun 02 13:26:59.888175 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-14f41ac1-eab3-44e5-904f-d75af11ca7a8 req-233500b7-2683-452b-96e0-d65b1f24d737 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082299 Jun 02 13:26:59.888765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 408/771] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:27:00.172767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:00.173392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:00.180092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:00.180570 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:00.181354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:00.181783 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:00.309932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:00.318458 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6e37391d-ccf3-4dd8-b9cc-a7d1dc02b3f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1723 microversion: 2.1 time: 0.149776 Jun 02 13:27:00.319024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 364/772] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:00 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:00.857878 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:00.858598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:00.865409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:00.865850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:00.866618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:00.867034 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:00.928461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:00.935778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a69cb036-e8d6-4044-90fc-df2545d3527a tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1472 microversion: 2.1 time: 0.082618 Jun 02 13:27:00.936368 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 409/773] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:00 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:01.335326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:01.335974 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:01.342820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:01.343293 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:01.344085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:01.344528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:01.480279 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:01.489184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0a8e20b6-ed9b-4068-92b2-b0dc351b52f8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1723 microversion: 2.1 time: 0.157249 Jun 02 13:27:01.489758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 365/774] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:01 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:01.953745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:01.954303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:01.957413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.962259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:01.962971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:01.963738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:01.964211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:01.995332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:01.995781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:01.996258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lazy-loading 'fault' on Instance uuid e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:27:02.037903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2113938dc6b94ec09e70771fdf570a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8522fa2a30e440b890516e350e17de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:02.045341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-13a58b64-914e-494e-8add-e4655cf07e82 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 200 len: 1308 microversion: 2.1 time: 0.095600 Jun 02 13:27:02.045907 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 410/775] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:01 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:02.510131 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:02.516809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:02.518787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:02.519233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:02.520032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:02.520610 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:02.654122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:02.663020 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ff7f1e16-c3bd-49da-a707-b62b866b52ca tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1729 microversion: 2.1 time: 0.156955 Jun 02 13:27:02.663590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 366/776] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:02 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:02.679898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:02.680402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:02.686840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:02.689407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:02.689407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:02.689407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:02.767772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3739fd95-7607-4988-9918-ce45816ea28e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091695 Jun 02 13:27:02.769633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 411/777] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:27:02 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:27:03.062554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:03.063133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] [instance: e8b25c17-6191-4f88-baa3-3dca3ac4e6b6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:03.069277 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:03.069828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:03.070595 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:03.071028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:03.084798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] HTTP exception thrown: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Request method failure captured: Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 HTTP/1.1 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLnIFpkHGeqDMat7V71RcUWsd0UnOzROfiUGZwZxKtdSBLAH3zrsa7Clg8wj4vIICx5PJRiMAVvLt2I2z8JOWdHJTuTboOa6KJpnWjoFYTwKQQUZQ74zym_NrY9hDBVjV1V5P2gMHokiO6vxuryxwK_4wiwY57w9xy4Alo-XYsPPrRc Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 8522fa2a30e440b890516e350e17de14 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:27:03.100594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8522fa2a30e440b890516e350e17de14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8522fa2a30e440b890516e350e17de14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8522fa2a30e440b890516e350e17de14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8522fa2a30e440b890516e350e17de14"}]}] Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 8522fa2a30e440b890516e350e17de14 Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-381065025 Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotTestJSON-381065025-project Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 2113938dc6b94ec09e70771fdf570a85 Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotTestJSON-381065025-project Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. Jun 02 13:27:03.102782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'e8b25c17-6191-4f88-baa3-3dca3ac4e6b6'} Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:27:03.103669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. Jun 02 13:27:03.105164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:27:03.106479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] Returning 404 to user: Instance e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:27:03.106479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07e138bf-261f-4541-b5a2-980fea7413f6 tempest-VolumesSnapshotTestJSON-381065025 tempest-VolumesSnapshotTestJSON-381065025-project] 10.222.0.46 "GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6" status: 404 len: 111 microversion: 2.1 time: 0.029476 Jun 02 13:27:03.106479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 367/778] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:03 2022] GET /compute/v2.1/servers/e8b25c17-6191-4f88-baa3-3dca3ac4e6b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:27:03.711568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-10fe7402-92bc-4914-a494-20acae096359 req-501f07d6-a9c6-4ee6-bf72-0e392286e599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:03.719921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-10fe7402-92bc-4914-a494-20acae096359 req-501f07d6-a9c6-4ee6-bf72-0e392286e599 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:03.720655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-10fe7402-92bc-4914-a494-20acae096359 req-501f07d6-a9c6-4ee6-bf72-0e392286e599 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:03.738829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-10fe7402-92bc-4914-a494-20acae096359 req-501f07d6-a9c6-4ee6-bf72-0e392286e599 service nova] Creating event network-changed:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:27:03.744911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-10fe7402-92bc-4914-a494-20acae096359 req-501f07d6-a9c6-4ee6-bf72-0e392286e599 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037456 Jun 02 13:27:03.746026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 412/779] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:27:05.759645 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-27f88369-950f-4077-a4cf-a234c49862a1 req-021f97ca-5d31-4f94-9267-6dc0ea3e66eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:05.768933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-27f88369-950f-4077-a4cf-a234c49862a1 req-021f97ca-5d31-4f94-9267-6dc0ea3e66eb service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:05.769379 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-27f88369-950f-4077-a4cf-a234c49862a1 req-021f97ca-5d31-4f94-9267-6dc0ea3e66eb service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:05.780314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-27f88369-950f-4077-a4cf-a234c49862a1 req-021f97ca-5d31-4f94-9267-6dc0ea3e66eb service nova] Creating event network-changed:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:27:05.785190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-27f88369-950f-4077-a4cf-a234c49862a1 req-021f97ca-5d31-4f94-9267-6dc0ea3e66eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029223 Jun 02 13:27:05.785764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 368/780] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:27:09.056181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:09.056845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:09.063030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:09.063465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:09.064856 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:09.065292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:09.152772 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lazy-loading 'services' on Instance uuid 1e59264d-5544-48cd-a508-5c7b119cfeae {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:27:09.441402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-84adb397-937d-4d15-a3ab-c7b12f7e7d73 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments/e84d3c83-5634-4dba-b840-7e53e81935bd" status: 202 len: 0 microversion: 2.1 time: 0.488580 Jun 02 13:27:09.441991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 413/781] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:27:08 2022] DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments/e84d3c83-5634-4dba-b840-7e53e81935bd => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:27:12.658226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d21a0735-90d9-43d7-851b-ee6eef69ca00 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:12.664577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d21a0735-90d9-43d7-851b-ee6eef69ca00 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:12.665040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d21a0735-90d9-43d7-851b-ee6eef69ca00 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:12.686290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d21a0735-90d9-43d7-851b-ee6eef69ca00 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Going to try to stop instance {{(pid=118131) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 13:27:12.851802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d21a0735-90d9-43d7-851b-ee6eef69ca00 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action" status: 202 len: 0 microversion: 2.1 time: 0.198418 Jun 02 13:27:12.853372 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 369/782] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:27:12 2022] POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:27:12.862418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:12.863225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:12.870886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:12.876876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:12.876876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:12.876876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:13.007302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:13.015493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-32feaf94-97ab-4a22-ad55-9254af4391f6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.158409 Jun 02 13:27:13.016094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 414/783] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:12 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:14.034411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:14.035113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:14.041544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:14.042003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:14.046460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:14.046460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:14.186202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:14.196129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1973bbfb-8a4c-4928-9a18-8b045bf9041a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.166966 Jun 02 13:27:14.196694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 370/784] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:14 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:15.206910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633393007", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160009625", "security_groups": [{"name": "tempest-secgroup-smoke-705320696"}], "block_device_mapping_v2": [{"uuid": "61b85096-f3a0-4a46-9380-3eee42639f8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "078003a7-efc0-4857-99dc-d1c589b32c88"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:15.214773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:15.215527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:15.224427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:15.224427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:15.225106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:15.225554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:15.339955 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] validate_networks() for [('078003a7-efc0-4857-99dc-d1c589b32c88', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:27:15.367631 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:15.375513 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5402d37b-76f0-41d7-9f92-33750b792ac4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.164803 Jun 02 13:27:15.377012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 371/785] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:15 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:15.717433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:27:15.717907 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:27:15.718415 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:27:15.718824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:27:15.719234 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:27:15.728527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:15.728976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:15.729773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:15.730222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:15.748058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:27:15.752699 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for user 14bd9be0202b433cb1fa8be6afee8ee5 and project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:27:15.810849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:27:15.813041 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b85096-f3a0-4a46-9380-3eee42639f8d',volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:27:16.181895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f194003e-7d11-4142-8570-8bb8a891916a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.979851 Jun 02 13:27:16.182463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 415/786] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:27:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:27:16.192633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8a3ca894-5759-4ce5-babd-7904f451bc34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:16.193239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8a3ca894-5759-4ce5-babd-7904f451bc34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:16.247110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8a3ca894-5759-4ce5-babd-7904f451bc34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:16.259778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8a3ca894-5759-4ce5-babd-7904f451bc34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1093 microversion: 2.1 time: 0.066838 Jun 02 13:27:16.259778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 372/787] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:16 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:16.394444 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:16.395079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:16.401423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:16.401867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:16.402627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:16.403057 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:16.533515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:16.541436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bcd973a8-0858-4d8b-938d-db92bd047b03 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.151501 Jun 02 13:27:16.542002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 416/788] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:16 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:17.272871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:17.273754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:17.280819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.281271 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.282052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.282712 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.357274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:17.365302 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-545dce13-05e2-4f39-bdf5-aa4122d8d22c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1143 microversion: 2.1 time: 0.096281 Jun 02 13:27:17.365887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 373/789] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:17 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:17.559200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:17.560123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:17.567534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.568008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.568791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.569221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.654700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:17.655685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:17.662219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.662661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.663410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.663837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.705502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:17.710791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:17.713743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-de5f9aa1-feec-4326-90c0-2a6f57e69daa tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.158544 Jun 02 13:27:17.714402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 417/790] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:17 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:17.853782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8284e5da-f60f-4795-b3c0-a18784ea4072 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action" status: 202 len: 0 microversion: 2.1 time: 0.202735 Jun 02 13:27:17.857500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 374/791] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:27:17 2022] POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:27:17.864135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:17.864844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:17.871099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.871653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:17.872525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:17.872960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:18.012339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:18.020744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9938d6c3-2a26-4c26-9795-ca8f65c14727 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1751 microversion: 2.1 time: 0.161211 Jun 02 13:27:18.021301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 418/792] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:17 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:18.383809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:18.384536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:18.391231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:18.391678 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:18.393046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:18.393484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:18.454877 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:18.462353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e4bb7e79-60bc-4be5-8c73-590469f425e1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1191 microversion: 2.1 time: 0.083395 Jun 02 13:27:18.463174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 375/793] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:18 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:18.731693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:18.732341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:18.739285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:18.739732 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:18.740522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:18.740962 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:18.872425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:18.880459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-981913f2-652e-4b38-921c-2db5c0b92ccf tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.152726 Jun 02 13:27:18.881025 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 419/794] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:18 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:19.038121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:19.038646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:19.044688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.045131 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:19.045875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.046300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:19.186830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:19.194785 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7cc93722-56f1-4619-8bd9-8e2ab12f7c12 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1751 microversion: 2.1 time: 0.160651 Jun 02 13:27:19.195348 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 376/795] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:19 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:19.478644 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:19.479251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:19.485398 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.485882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:19.486690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.487133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:19.547928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:19.555276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-baf4a5e4-6518-47a3-b100-226d15aeac34 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1191 microversion: 2.1 time: 0.080624 Jun 02 13:27:19.555840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 420/796] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:19 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:19.898452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:19.899043 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:19.905837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.906278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:19.907048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:19.907474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:20.046615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:20.054388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1f7b2d35-b919-4696-bd19-73f3dedac33b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.159857 Jun 02 13:27:20.054968 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 377/797] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:19 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:20.211686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:20.212291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:20.219965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:20.220409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:20.221183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:20.221614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:20.369451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:20.378159 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-08f0d68a-a542-48a4-853e-e5fd6e5db8ae tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1751 microversion: 2.1 time: 0.170380 Jun 02 13:27:20.378731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 421/798] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:20 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:20.571786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:20.572350 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:20.578481 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:20.578931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:20.579691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:20.580156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:20.639774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:20.647159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a1f426cb-9e41-4e0b-812a-6f3922007799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1191 microversion: 2.1 time: 0.079458 Jun 02 13:27:20.647721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 378/799] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:20 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:21.072409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:21.073026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:21.079079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.080067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.080832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.081272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.209990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:21.218171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a02c28b0-524c-4bb0-a357-deef1f1cce3b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.149662 Jun 02 13:27:21.218770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 422/800] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:21 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:21.395182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:21.395797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:21.402435 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.402875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.403633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.404092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.560584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:21.560584 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1ac78739-7bf3-4152-857b-f7630e569bb5 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1751 microversion: 2.1 time: 0.169829 Jun 02 13:27:21.561087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 379/801] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:21 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:21.664615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:21.665145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:21.672312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.678504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.678504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:21.678504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:21.737249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:21.741567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.747059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e563fcf3-71d7-469d-b01b-d528c05add41 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1191 microversion: 2.1 time: 0.086472 Jun 02 13:27:21.747844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 423/802] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:21 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:22.236712 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:22.237439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:22.244140 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.244812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.245555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.246003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.430856 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:22.439339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-becb39fa-6347-4738-a5d3-6edebe0ebeb1 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.206405 Jun 02 13:27:22.440061 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 380/803] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:22 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:22.578950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:22.579546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:22.586880 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.587899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.589021 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.589620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.764519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:22.765591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:22.768765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=50 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:22.774772 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.775616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.780617 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:22.781400 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:22.869572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:22.878303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-176a1f07-08a5-4227-8360-c3b29ed5c9e0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1209 microversion: 2.1 time: 0.117806 Jun 02 13:27:22.878893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 381/804] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:22 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:23.082635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:23.092064 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6c883f19-cfe9-45db-abad-0e7eeac4268c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1751 microversion: 2.1 time: 0.516567 Jun 02 13:27:23.092264 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 424/805] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:22 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1751 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:23.457732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:23.458340 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:23.465443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:23.466657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:23.467165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:23.467165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:23.649634 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:23.658377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5f5e48af-0615-427c-99f7-5fdf1e574a67 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.205724 Jun 02 13:27:23.658967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 382/806] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:23 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:23.896003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:23.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:23.904056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:23.904504 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:23.905274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:23.905705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.125931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:24.125931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:24.125931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:24.135414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:24.140142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.141116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:24.141596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.152177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ff6c709-5100-44f2-8ff6-399b046c97cd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1276 microversion: 2.1 time: 0.255277 Jun 02 13:27:24.152177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 425/807] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:23 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:24.352423 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:24.361738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-80550fbb-4038-4a81-b827-73194784ca2c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.256348 Jun 02 13:27:24.362314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 383/808] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:24 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:24.521674 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-3315b909-2473-4921-ad8c-656196436463 req-44f2096a-9fd1-49ee-857a-53a2f23cd541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a92ef8-3817-4bc0-9020-ec93a0c61dd6", "tag": "590b0692-8b79-4eed-aa0b-99e7b95057de"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:24.535018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3315b909-2473-4921-ad8c-656196436463 req-44f2096a-9fd1-49ee-857a-53a2f23cd541 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:24.535995 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3315b909-2473-4921-ad8c-656196436463 req-44f2096a-9fd1-49ee-857a-53a2f23cd541 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.557882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-3315b909-2473-4921-ad8c-656196436463 req-44f2096a-9fd1-49ee-857a-53a2f23cd541 service nova] Creating event network-changed:590b0692-8b79-4eed-aa0b-99e7b95057de for instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 on hv-cinder-79760 Jun 02 13:27:24.562746 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-3315b909-2473-4921-ad8c-656196436463 req-44f2096a-9fd1-49ee-857a-53a2f23cd541 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045527 Jun 02 13:27:24.563688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 426/809] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:27:24.676236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:24.677023 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:24.685281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:24.685732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.687468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:24.687468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:24.822233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:24.830623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc231093-cfa4-476c-a1fc-2b131afeba23 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.158428 Jun 02 13:27:24.831192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 384/810] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:24 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:25.165485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:25.166218 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:25.172595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.173694 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.174469 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.174910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.362070 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:25.369873 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d2dd012f-3bf0-476e-9770-c2f1c3a1d57c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.209262 Jun 02 13:27:25.370445 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 427/811] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:25 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:25.383906 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:25.384617 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:25.390950 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.394958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.394958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.394958 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.538604 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:25.546633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bf655e95-65c7-4cbb-907d-0fcc305920b3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.172067 Jun 02 13:27:25.547214 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 385/812] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:25 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:25.849488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:25.850099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:25.852086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.852753 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.858348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.858799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.859569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:25.860035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:25.990632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:25.998116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c46ac91-0d52-4522-ba01-40ef7a5db25a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.152464 Jun 02 13:27:25.998682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 428/813] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:25 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:26.387739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:26.388392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:26.390704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:26.396267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:26.396657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:26.397413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:26.397842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:26.525912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:26.533455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-df1545e9-662d-43a4-8ead-d4b17a36ea45 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.149616 Jun 02 13:27:26.534052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 386/814] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:26 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:26.564673 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:26.565284 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:26.572133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:26.572580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:26.573376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:26.573845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:26.718012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:26.726640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-79de12fc-f2da-45ce-b195-afda6a2fe20b tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.166454 Jun 02 13:27:26.727207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 429/815] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:26 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:27.016234 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:27.017357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:27.023312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.023763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.024572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.025019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.161384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:27.169199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-81b37a7a-a45d-46fa-bd7b-19c33007ece4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.157019 Jun 02 13:27:27.169766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 387/816] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:27 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:27.549976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:27.550491 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:27.557046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.557493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.558257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.558691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.694914 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:27.702577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f07c70d5-1269-46d3-af90-5e9094e5a699 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.156973 Jun 02 13:27:27.703139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 430/817] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:27 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:27.744648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:27.745305 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:27.752498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.752940 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.753733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:27.754165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:27.897522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:27.905632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f7af6d08-9f60-489b-8748-c6435544d6f6 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.164888 Jun 02 13:27:27.906199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 388/818] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:27 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:28.186593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:28.187209 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:28.193664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.196067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:28.196067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.196067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:28.324185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:28.332256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-78db7e4c-0b27-4304-81b6-5f1fac079240 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1677 microversion: 2.1 time: 0.149528 Jun 02 13:27:28.332842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 431/819] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:28 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:28.721123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:28.721645 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:28.728110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.728574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:28.729331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.729761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:28.867459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:28.875297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-db964045-d358-4126-9d20-bdb39f0a84ae tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.158649 Jun 02 13:27:28.876389 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 389/820] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:28 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:28.922905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:28.923545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:28.930382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.930832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:28.931606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:28.932078 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.075548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:29.084334 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-52d0419c-2db8-4f33-a5ad-56e5bc18dfcb tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.165307 Jun 02 13:27:29.084906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 432/821] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:28 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:29.350425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:29.351037 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:29.357297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.357741 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.358497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.358936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.495467 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:29.498112 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:29.505175 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-23333041-053c-40dd-90c8-b797bf15a7a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1654 microversion: 2.1 time: 0.158493 Jun 02 13:27:29.505776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 390/822] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:29 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:29.522749 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0eefbd15-9589-4afb-a0e5-346dbc0e141c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:29.529295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0eefbd15-9589-4afb-a0e5-346dbc0e141c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.529735 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0eefbd15-9589-4afb-a0e5-346dbc0e141c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.555568 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0eefbd15-9589-4afb-a0e5-346dbc0e141c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Going to try to start instance {{(pid=118132) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 13:27:29.726206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0eefbd15-9589-4afb-a0e5-346dbc0e141c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action" status: 202 len: 0 microversion: 2.1 time: 0.207157 Jun 02 13:27:29.726756 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 433/823] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:27:29 2022] POST /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:27:29.735172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:29.736762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:29.743733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.744215 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.744992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.745431 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.879596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:29.887788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c6f68005-e3b4-40ab-85fa-b6fca7614a51 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1663 microversion: 2.1 time: 0.156758 Jun 02 13:27:29.889567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 391/824] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:29 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:29.892925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:29.894063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:29.900611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.901059 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:29.901895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:29.902414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:30.102845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:30.103442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:30.113548 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:30.114171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:30.115050 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:30.115633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:30.135129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:30.149179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-73cb15b5-568f-4569-b438-0988e899c1e3 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.260506 Jun 02 13:27:30.150021 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 434/825] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:29 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:30.269314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:30.278038 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-574869de-c422-4d05-93a4-0aa188c985d8 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.179665 Jun 02 13:27:30.278649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 392/826] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:30 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:30.905924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:30.906432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:30.913335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:30.913784 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:30.914555 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:30.914991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:31.057893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:31.066178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f7dcde21-616a-468b-8215-c7e190e5ad7a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1663 microversion: 2.1 time: 0.164222 Jun 02 13:27:31.066747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 435/827] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:30 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:31.166819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:31.167370 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:31.174001 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:31.174450 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:31.175249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:31.175690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:31.296185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:31.296966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:31.303380 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:31.304027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:31.304815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:31.305259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:31.308426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:31.316567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f45c949b-aa21-4204-908a-2f36f9bf1e89 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.153797 Jun 02 13:27:31.317162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 393/828] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:31 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:31.453910 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:31.462859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-49dbabb0-9790-4da9-a4a5-1958f3db119f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.170387 Jun 02 13:27:31.463565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 436/829] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:31 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:32.083803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:32.084465 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:32.090762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.091208 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.091995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.092432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.223231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:32.230762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5760c8dc-b18e-49bd-add4-9b644808bc1b tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1667 microversion: 2.1 time: 0.150831 Jun 02 13:27:32.231325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 394/830] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:32 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:32.333641 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:32.334259 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:32.341257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.342807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.342807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.343117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.480023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:32.481027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:32.481683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:32.487932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dfb8e408-8da6-4153-8d63-adf75fb70983 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.158736 Jun 02 13:27:32.488133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.488434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.488860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 437/831] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:32 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:32.489212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.489648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.638223 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:32.645647 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e7643587-756a-4ff5-a7d8-a7d9dfaaf455 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.168478 Jun 02 13:27:32.646239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 395/832] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:32 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:27:33.505608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:33.509853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:33.513110 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:33.513638 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:33.514489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:33.515184 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:33.665856 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:33.666739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:33.676300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:33.677021 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:33.677965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:33.678738 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:33.692721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:33.707142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2af26519-0752-429a-bfbe-bf1e22a74928 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.205217 Jun 02 13:27:33.707740 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 438/833] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:33 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:33.941692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:33.949938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0835e5c9-7852-49d0-b1e6-a35a5434c149 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1756 microversion: 2.1 time: 0.289694 Jun 02 13:27:33.950523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 396/834] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:33 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:34.725577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:34.726209 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:34.733634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:34.734262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:34.735921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:34.736461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:34.895283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:34.903017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-39dc5c57-f8ea-4590-b102-9cfa9d0cdb28 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.182054 Jun 02 13:27:34.903778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 439/835] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:34 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:34.931263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-c353466d-bef4-4605-a28b-44a6c8795c3b req-2a982311-18f2-48d0-bc45-6aff5c09840d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a92ef8-3817-4bc0-9020-ec93a0c61dd6", "name": "network-vif-plugged", "status": "completed", "tag": "590b0692-8b79-4eed-aa0b-99e7b95057de"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:34.940628 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c353466d-bef4-4605-a28b-44a6c8795c3b req-2a982311-18f2-48d0-bc45-6aff5c09840d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:34.941066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c353466d-bef4-4605-a28b-44a6c8795c3b req-2a982311-18f2-48d0-bc45-6aff5c09840d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:34.953904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-c353466d-bef4-4605-a28b-44a6c8795c3b req-2a982311-18f2-48d0-bc45-6aff5c09840d service nova] Creating event network-vif-plugged:590b0692-8b79-4eed-aa0b-99e7b95057de for instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 on hv-cinder-79760 Jun 02 13:27:34.960661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-c353466d-bef4-4605-a28b-44a6c8795c3b req-2a982311-18f2-48d0-bc45-6aff5c09840d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 Jun 02 13:27:34.962026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 397/836] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:27:34.969111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:34.969230 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:34.997009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:34.997709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:34.998733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:34.999150 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:35.004431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.147274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:35.155116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-26dd19b8-0bb8-4794-a0e5-ca98311fa190 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1759 microversion: 2.1 time: 0.191152 Jun 02 13:27:35.155689 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 440/837] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:34 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:35.920615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:35.921506 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:35.928818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:35.929264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:35.930113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:35.930551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:36.071448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:36.080257 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3bfe2799-b605-402c-9976-8791f8b9364a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.163915 Jun 02 13:27:36.081045 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 398/838] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:35 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:37.097791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:37.098374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:37.105600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:37.106043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:37.106797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:37.107229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:37.239249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:37.246868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6ca5793c-7ff8-46b9-a55e-a91a071f5e92 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1264 microversion: 2.1 time: 0.152956 Jun 02 13:27:37.247453 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 441/839] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:37 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:38.263109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:38.263717 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:38.270810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:38.276019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:38.276019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:38.276019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:38.404120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:38.412399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e792fcaa-6003-491a-b901-5bd617f4bd4c tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1451 microversion: 2.1 time: 0.153073 Jun 02 13:27:38.412972 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 399/840] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:38 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:38.432479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:38.433085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:27:38.440040 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:38.449072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:38.449072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:38.449072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:38.577996 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:27:38.586155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4d37235a-f76f-48c5-a9eb-3c03a59dd003 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1451 microversion: 2.1 time: 0.157633 Jun 02 13:27:38.586726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 442/841] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:27:38 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:27:40.952197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-5e8b12be-11e9-412e-bed9-a48a01a34583 req-c37305b0-186c-4614-8b37-4f31d9ccc7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a92ef8-3817-4bc0-9020-ec93a0c61dd6", "tag": "590b0692-8b79-4eed-aa0b-99e7b95057de"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:40.960878 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5e8b12be-11e9-412e-bed9-a48a01a34583 req-c37305b0-186c-4614-8b37-4f31d9ccc7fc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:40.961312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5e8b12be-11e9-412e-bed9-a48a01a34583 req-c37305b0-186c-4614-8b37-4f31d9ccc7fc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:40.973221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-5e8b12be-11e9-412e-bed9-a48a01a34583 req-c37305b0-186c-4614-8b37-4f31d9ccc7fc service nova] Creating event network-changed:590b0692-8b79-4eed-aa0b-99e7b95057de for instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 on hv-cinder-79760 Jun 02 13:27:40.978025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-5e8b12be-11e9-412e-bed9-a48a01a34583 req-c37305b0-186c-4614-8b37-4f31d9ccc7fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029477 Jun 02 13:27:40.978614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 400/842] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:27:59.577861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.578663 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=16 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.767511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9adbc376-e720-46f1-ad23-f7107f1ef22e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Action: 'create', calling method: .version_select at 0x7f5a73859c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-872029292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMv+uw4sHsZfm7rr+q1Vz6J5syj13uXSpUfbLw3EAUv3H0wNfewqAkhnDs/F56U++hgIIDKEd4bV1rxa6HiSAEqlUVhjrlFxGfHQdjpvGlGAZs84V2Gsmf/U+hczU+3hw=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:27:59.784818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-9adbc376-e720-46f1-ad23-f7107f1ef22e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Getting quotas for project a67e5bfde6ef4a358150b1ba035d5f1a. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:27:59.789095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-9adbc376-e720-46f1-ad23-f7107f1ef22e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Getting quotas for user 8446bcbe46d041789a0a7c5c270fd7ef and project a67e5bfde6ef4a358150b1ba035d5f1a. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:27:59.900903 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9adbc376-e720-46f1-ad23-f7107f1ef22e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.327910 Jun 02 13:27:59.901516 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 443/843] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:27:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:01.785907 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=39 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:01.786664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=53 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:01.791025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:01.791612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:01.798002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:01.798448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:01.799211 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:01.799730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:01.831201 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c90353ea-997f-4b5c-9652-fa0168635bf9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments/9c4f2603-f4d9-4038-9454-db319f091470" status: 200 len: 194 microversion: 2.20 time: 0.046867 Jun 02 13:28:01.832306 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 401/844] 10.222.0.46 () {60 vars in 1453 bytes} [Thu Jun 2 13:28:01 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments/9c4f2603-f4d9-4038-9454-db319f091470 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:01.915561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:01.921496 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:01.929352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:01.930360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:01.931658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:01.932300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:02.029002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lazy-loading 'services' on Instance uuid 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:02.294403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-732e959d-4dff-48e2-9648-161e78a57166 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments/9c4f2603-f4d9-4038-9454-db319f091470" status: 202 len: 0 microversion: 2.20 time: 0.384630 Jun 02 13:28:02.295268 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 444/845] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Jun 2 13:28:01 2022] DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments/9c4f2603-f4d9-4038-9454-db319f091470 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:02.305579 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:02.309298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:02.317826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:02.319226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:02.320179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:02.320539 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:02.370657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d2e6de5c-ae95-4445-a1d0-0558305b5d12 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069526 Jun 02 13:28:02.371836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 402/846] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 2 13:28:02 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:03.385302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:03.386335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:03.392665 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:03.393114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:03.393882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:03.394312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:03.427594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b6ced916-c1b0-4c6f-b1c3-1c04ad6be29f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047022 Jun 02 13:28:03.428460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 445/847] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 2 13:28:03 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:04.439448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:04.440436 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:04.446880 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.447327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.448115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.448548 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.477170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4f8e02d7-c9f3-4678-8d1a-d9e41e263879 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042342 Jun 02 13:28:04.477726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 403/848] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 2 13:28:04 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:04.534989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:04.535484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:04.541911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.542353 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.543105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.543538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.570156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:04.796363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d851efa5-3ec6-4045-ba2b-ed281ffad12d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 204 len: 0 microversion: 2.20 time: 0.264890 Jun 02 13:28:04.796958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 446/849] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 2 13:28:04 2022] DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:28:04.805955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:04.806574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:04.814339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.823944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.823944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:04.823944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:04.949609 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:04.957589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:04.959109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:04.960895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5cba707f-be2d-4617-b22e-6c47c67f5bf7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.158394 Jun 02 13:28:04.960895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 404/850] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:04 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:28:05.980234 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:05.980835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:05.987842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:05.988325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:05.989088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:05.989523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:06.121379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:06.129938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:06.131437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:06.132738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-490be727-0104-47eb-ab9c-59f494be6355 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.156955 Jun 02 13:28:06.133373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 447/851] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:05 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:07.152019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:07.152622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:07.160174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:07.160618 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:07.161385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:07.161814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:07.306319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:07.317768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:07.319385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:07.320712 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f3da5123-3358-4489-8788-1d181798a1c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1726 microversion: 2.20 time: 0.172630 Jun 02 13:28:07.321276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 405/852] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:07 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:28:07.766759 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-ab890225-44c8-428e-b5df-b1de0d7fb0cc req-65ae0772-ad6c-4d53-8db3-b08ccf5f9d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c5435-b1b4-4edb-8f58-1f8ffcf87f06", "name": "network-vif-deleted", "tag": "f670823a-d559-4c05-91d7-c836df263d45"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:07.777438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-ab890225-44c8-428e-b5df-b1de0d7fb0cc req-65ae0772-ad6c-4d53-8db3-b08ccf5f9d3e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:07.783523 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-ab890225-44c8-428e-b5df-b1de0d7fb0cc req-65ae0772-ad6c-4d53-8db3-b08ccf5f9d3e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:07.793678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-ab890225-44c8-428e-b5df-b1de0d7fb0cc req-65ae0772-ad6c-4d53-8db3-b08ccf5f9d3e service nova] Creating event network-vif-deleted:f670823a-d559-4c05-91d7-c836df263d45 for instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 on hv-cinder-79760 Jun 02 13:28:07.801673 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-ab890225-44c8-428e-b5df-b1de0d7fb0cc req-65ae0772-ad6c-4d53-8db3-b08ccf5f9d3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039237 Jun 02 13:28:07.802211 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 448/853] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:08.342320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:08.342933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:08.350016 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:08.350543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:08.351323 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:08.351767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:08.386188 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:08.386640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:08.387091 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lazy-loading 'fault' on Instance uuid 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:08.434286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:08.445654 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:08.447983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:08.449421 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f59dbb3a-a6dc-4a09-b463-54f6f4b5d22d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 200 len: 1372 microversion: 2.20 time: 0.112211 Jun 02 13:28:08.450104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 406/854] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:08 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:09.469951 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:09.470648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:09.476870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:09.477312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:09.478068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:09.478500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:09.491389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 HTTP/1.1 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:28:09.493032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:28:09.494531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '384c5435-b1b4-4edb-8f58-1f8ffcf87f06'} Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:09.495339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:28:09.496676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:09.497827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:09.497827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-41914723-2891-462d-8596-526baaaae4ee tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 404 len: 111 microversion: 2.20 time: 0.029182 Jun 02 13:28:09.497827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 449/855] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:09 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:28:09.504203 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aaecf2c9-8386-4499-aa61-c0e9dd074e67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '.version_select at 0x7f5a8055e160>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:09.507356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aaecf2c9-8386-4499-aa61-c0e9dd074e67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 13:28:10.516599 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [None req-aaecf2c9-8386-4499-aa61-c0e9dd074e67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 37246. Jun 02 13:28:10.592134 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aaecf2c9-8386-4499-aa61-c0e9dd074e67 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623527987" status: 204 len: 0 microversion: 2.20 time: 1.092355 Jun 02 13:28:10.592713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 407/856] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jun 2 13:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623527987 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:28:11.710839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0164ec00-b9be-4286-af74-3baa72c2738c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: .version_select at 0x7f5a8563d8b0>, body: {"keypair": {"name": "tempest-keypair-1845145606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3EsGoYT6DQ9VH49w0WzhW5YaI/nEK8GS8/EOWbW3L3OxDVrkod9Z0WQfHUgZSGz7csGMu25r2ip43ZO9wQHVfIrZQc+rJyil1AE17rp+QFLUxSP0tcUElPP37DaEfGXA=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:11.715451 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:11.727108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-0164ec00-b9be-4286-af74-3baa72c2738c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for project afa347af05aa4e40b5960fd0aea87c54. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:28:11.730989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-0164ec00-b9be-4286-af74-3baa72c2738c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for user 37a7776277ca42eba4476242438fbf6d and project afa347af05aa4e40b5960fd0aea87c54. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:28:11.814925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0164ec00-b9be-4286-af74-3baa72c2738c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108203 Jun 02 13:28:11.815506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 450/857] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jun 2 13:28:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:14.079691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-90835770", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0740c50-521e-4167-b47e-482ca4a8ede8"}], "security_groups": [{"name": "tempest-securitygroup--287686323"}], "key_name": "tempest-keypair-1845145606", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:14.184957 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] validate_networks() for [('b0740c50-521e-4167-b47e-482ca4a8ede8', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:28:14.550922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:28:14.551345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:28:14.551818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:28:14.552262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:28:14.552786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:28:14.561597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:14.562303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:14.563620 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:14.564087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:14.581375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for project afa347af05aa4e40b5960fd0aea87c54. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:28:14.585298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Getting quotas for user 37a7776277ca42eba4476242438fbf6d and project afa347af05aa4e40b5960fd0aea87c54. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:28:14.596779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:28:14.599044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:28:14.692565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-411403f1-58cd-410b-a650-06f143cbf883 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.617835 Jun 02 13:28:14.693070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 408/858] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Jun 2 13:28:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 13:28:14.704124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:14.715383 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:14.775997 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:14.783642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:14.785168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:14.786273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fba1acd4-0841-41dd-95b8-eae79917d6a1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1280 microversion: 2.20 time: 0.087234 Jun 02 13:28:14.786816 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 451/859] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:14 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:15.804996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:15.806040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:15.813774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:15.814218 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:15.814977 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:15.815427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:15.877390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:15.885310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:15.886820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:15.887981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-47b410ad-e859-4bfc-b05b-c568c6c32c3c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1276 microversion: 2.20 time: 0.087981 Jun 02 13:28:15.888544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 409/860] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:15 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:16.905142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:16.905741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:16.912396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:16.912835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:16.913634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:16.914068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:16.991585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:16.999853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:17.001907 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:17.003007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3f3f648b-b1e0-4830-a0d3-a09bc3b6499e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1338 microversion: 2.20 time: 0.101801 Jun 02 13:28:17.003559 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 452/861] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:16 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:18.022276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:18.023568 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:18.030717 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:18.032074 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:18.033042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:18.033654 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:18.176201 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:18.184483 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:18.185970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:18.187066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ef46620e-01f3-4118-8ae5-5ff6eb04e32b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.169468 Jun 02 13:28:18.187626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 410/862] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:18 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:18.280033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-3d94dd36-3946-4032-a84d-6bd27bd82704 req-007de111-8f60-43f4-af5a-ab3ca5d4dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:18.289830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3d94dd36-3946-4032-a84d-6bd27bd82704 req-007de111-8f60-43f4-af5a-ab3ca5d4dd77 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:18.290560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3d94dd36-3946-4032-a84d-6bd27bd82704 req-007de111-8f60-43f4-af5a-ab3ca5d4dd77 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:18.304835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-3d94dd36-3946-4032-a84d-6bd27bd82704 req-007de111-8f60-43f4-af5a-ab3ca5d4dd77 service nova] Creating event network-changed:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:28:18.313822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-3d94dd36-3946-4032-a84d-6bd27bd82704 req-007de111-8f60-43f4-af5a-ab3ca5d4dd77 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037674 Jun 02 13:28:18.315049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 453/863] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:19.203949 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:19.204589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:19.210936 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:19.211384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:19.212477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:19.212915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:19.339157 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:19.347587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:19.349122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:19.350272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-29f8e3a1-fa1f-4a74-b5a9-f4320764ef13 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.150305 Jun 02 13:28:19.350836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 411/864] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:19 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:19.993571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:19.994152 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:20.000803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.001248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.001999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.002430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.080863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'services' on Instance uuid 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:20.326212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b13a5c4b-4a50-41c9-a038-6f391bd684d4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments/32261d0a-1902-42b7-a6d2-7769a4ed2483" status: 202 len: 0 microversion: 2.1 time: 0.336647 Jun 02 13:28:20.326796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 454/865] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:28:19 2022] DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments/32261d0a-1902-42b7-a6d2-7769a4ed2483 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:28:20.335751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:20.339358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:20.343516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.344557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.345331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.345763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.369069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:20.369754 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:20.374266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6e02c624-f4c6-4ad1-b216-a69418999de8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042391 Jun 02 13:28:20.375018 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 412/866] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:20 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:20.376219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.376664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.377431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:20.377868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:20.510983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:20.519575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:20.521095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:20.522186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d0270871-13c6-4add-b0f3-105428d5ddcf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.157380 Jun 02 13:28:20.522733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 455/867] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:20 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:28:21.386268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:21.387186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:21.394341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:21.394788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:21.395553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:21.396020 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:21.424721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-28cb1bd9-ab1d-4928-8155-911a5fac641d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042576 Jun 02 13:28:21.425275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 413/868] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:21 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:21.540127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:21.540737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:21.547236 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:21.547681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:21.548503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:21.548941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:21.679648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:21.688174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:21.689697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:21.690795 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bbda5bd4-8a0c-4653-aa8f-9961261fe5e9 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.154614 Jun 02 13:28:21.691352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 456/869] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:21 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:22.436512 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:22.437369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:22.443831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:22.444307 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:22.445066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:22.445505 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:22.474827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5d3069ce-d977-4dff-ac31-cde8531c636f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042463 Jun 02 13:28:22.475387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 414/870] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:22 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:22.709234 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:22.709762 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:22.716625 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:22.717069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:22.717818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:22.718247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:22.846714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:22.854616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:22.856145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:22.857536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dda633e0-f931-4056-9b63-6ba918d50e9d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.152295 Jun 02 13:28:22.858087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 457/871] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:22 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:23.487189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:23.488162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:23.494750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:23.495196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:23.495994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:23.496434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:23.527490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d0f7d185-ca27-418b-9f17-24d0d12a8d59 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Jun 02 13:28:23.528070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 415/872] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:23 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:23.885155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:23.885748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:23.892192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:23.892635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:23.893384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:23.893813 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:24.034305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:24.042680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:24.044210 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:24.045309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-788e8234-5612-4f11-a5ab-0b2e9b31eb79 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.164061 Jun 02 13:28:24.045858 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 458/873] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:23 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:24.538724 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:24.539562 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:24.546086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:24.546534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:24.547288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:24.547733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:24.572707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.577111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f38c2b74-a4a7-4a79-b20a-255c32b3e136 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Jun 02 13:28:24.577669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 416/874] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:24 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:25.063885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:25.064550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:25.067162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:25.072574 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.072958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.073760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.074190 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.209105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:25.217845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:25.220117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:25.221023 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00b44767-0da7-47d1-9dcf-8b1a5ee5bfd5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.162336 Jun 02 13:28:25.221578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 459/875] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:25 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:28:25.590067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:25.590988 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:25.593560 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:25.601009 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.601454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.602233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.602644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.631859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7e8ec326-d540-41c7-9c98-9596cca60475 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046235 Jun 02 13:28:25.632359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 417/876] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:25 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:28:25.722594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:25.723397 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:25.729909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.730511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.732247 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:25.732854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:25.759933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:25.787890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:26.000466 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-93f2f0c4-3366-4530-a6b1-d622c245716e tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 204 len: 0 microversion: 2.1 time: 0.283869 Jun 02 13:28:26.000975 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 460/877] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:28:25 2022] DELETE /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:26.009059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:26.009672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:26.016314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:26.016768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:26.017528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:26.017963 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:26.149716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:26.153161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:26.158078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-611bd21b-c815-456f-92f5-eb0a2e32c6f1 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1689 microversion: 2.1 time: 0.152895 Jun 02 13:28:26.158648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 418/878] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:26 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:26.239058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:26.239747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:26.246293 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:26.246723 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:26.247477 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:26.247933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:26.374865 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:26.382963 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:26.384488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:26.385603 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c5165e51-cc9c-4192-940a-c18f348379a2 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.150874 Jun 02 13:28:26.386149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 461/879] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:26 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:27.141945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-ec65935b-1bc0-4c07-b1b7-e92d428a2c49 req-1358a8e5-1446-4914-a912-cfde1d546d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "name": "network-vif-plugged", "status": "completed", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:27.150698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ec65935b-1bc0-4c07-b1b7-e92d428a2c49 req-1358a8e5-1446-4914-a912-cfde1d546d06 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:27.151139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ec65935b-1bc0-4c07-b1b7-e92d428a2c49 req-1358a8e5-1446-4914-a912-cfde1d546d06 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:27.162843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-ec65935b-1bc0-4c07-b1b7-e92d428a2c49 req-1358a8e5-1446-4914-a912-cfde1d546d06 service nova] Creating event network-vif-plugged:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:28:27.168129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-ec65935b-1bc0-4c07-b1b7-e92d428a2c49 req-1358a8e5-1446-4914-a912-cfde1d546d06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030670 Jun 02 13:28:27.168731 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 419/880] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:27.177613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:27.177613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:27.181652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:27.182093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:27.182862 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:27.183302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:27.320873 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:27.328913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-87475f85-667f-4d10-a9cb-bec47d405f39 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1689 microversion: 2.1 time: 0.157442 Jun 02 13:28:27.329561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 462/881] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:27 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:27.404363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:27.405050 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:27.411542 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:27.412004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:27.412766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:27.413196 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:27.542298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:27.550176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:27.551681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:27.552847 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-efa5e701-0fc6-408d-a345-1ee47cec1e0d tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.152727 Jun 02 13:28:27.553409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 420/882] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:27 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:27.785470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-815709329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-872029292", "security_groups": [{"name": "tempest-secgroup-smoke-948555174"}], "networks": [{"uuid": "509c428b-240a-4af7-959c-4fcacb38abd7"}], "block_device_mapping_v2": [{"uuid": "fe780ce3-890f-41a5-8205-94117b97006d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:27.892974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] validate_networks() for [('509c428b-240a-4af7-959c-4fcacb38abd7', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:28:28.347317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:28.348742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:28.356424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.356967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.357865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.358376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.531811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:28.540360 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4f30340d-78a4-4f54-af6b-b3137c6db1c6 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1689 microversion: 2.1 time: 0.197252 Jun 02 13:28:28.544884 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 421/883] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:28 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:28.570527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:28.571137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:28.577263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.577646 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.578947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.579384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.596301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:28:28.596799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:28:28.597188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:28:28.597605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:28:28.598020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:28:28.607089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.608556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.609429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:28.609983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:28.628849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Getting quotas for project a67e5bfde6ef4a358150b1ba035d5f1a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:28:28.633196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Getting quotas for user 8446bcbe46d041789a0a7c5c270fd7ef and project a67e5bfde6ef4a358150b1ba035d5f1a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:28:28.693509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:28:28.695911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe780ce3-890f-41a5-8205-94117b97006d',volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:28:28.745598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:28.755758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:28.757321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:28.758427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fee5db91-81d7-4be0-a518-fd039ee04a22 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.191858 Jun 02 13:28:28.759034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 422/884] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:28 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:28:29.127306 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8e716df2-4bbd-4888-8b46-cc65a92da3a7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.345609 Jun 02 13:28:29.128736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 463/885] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:28:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:28:29.141703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-84ef853f-a9e2-4533-9dd9-f46fd8201600 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:29.142635 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-84ef853f-a9e2-4533-9dd9-f46fd8201600 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:29.229430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-84ef853f-a9e2-4533-9dd9-f46fd8201600 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:29.242574 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-84ef853f-a9e2-4533-9dd9-f46fd8201600 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1087 microversion: 2.1 time: 0.107618 Jun 02 13:28:29.243361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 423/886] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:29 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1087 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:29.558418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:29.559067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:29.575778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:29.576258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:29.577102 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:29.577534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:29.712522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:29.720282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31d07a3d-55db-4dbd-9a19-d0a0c4c0b724 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1689 microversion: 2.1 time: 0.166261 Jun 02 13:28:29.721051 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 464/887] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:29 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:29.778708 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:29.779336 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:29.789132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:29.789590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:29.790372 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:29.790820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:29.978236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:29.987546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:29.989570 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:29.991099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c4e87174-f115-4b33-b239-1fbb67207232 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1405 microversion: 2.20 time: 0.218059 Jun 02 13:28:29.991684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 424/888] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:29 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:30.133890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-28c31cd7-4389-49b9-9fc0-4ac0719e4e17 req-94fb1c43-95d8-4e3c-afb9-b5104a571efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3", "name": "network-vif-deleted", "tag": "0e846192-e0b3-4af4-8c0e-0b9c123ceb9b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:30.144086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:30.146651 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-28c31cd7-4389-49b9-9fc0-4ac0719e4e17 req-94fb1c43-95d8-4e3c-afb9-b5104a571efa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:30.147896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-28c31cd7-4389-49b9-9fc0-4ac0719e4e17 req-94fb1c43-95d8-4e3c-afb9-b5104a571efa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:30.161540 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-28c31cd7-4389-49b9-9fc0-4ac0719e4e17 req-94fb1c43-95d8-4e3c-afb9-b5104a571efa service nova] Creating event network-vif-deleted:0e846192-e0b3-4af4-8c0e-0b9c123ceb9b for instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 on hv-cinder-79760 Jun 02 13:28:30.167633 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-28c31cd7-4389-49b9-9fc0-4ac0719e4e17 req-94fb1c43-95d8-4e3c-afb9-b5104a571efa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036988 Jun 02 13:28:30.168944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 465/889] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:30.260442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:30.261071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:30.267673 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:30.268163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:30.268952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:30.269390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:30.333278 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:30.341417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-94a9f33b-5989-4135-91cc-3c6b82479850 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1137 microversion: 2.1 time: 0.085207 Jun 02 13:28:30.342008 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 425/890] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:30 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:30.738055 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:30.738954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:30.746759 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:30.752459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:30.752459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:30.752459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:30.838668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:30.848106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-750852b0-a982-487e-8b46-791f1031316d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 200 len: 1330 microversion: 2.1 time: 0.114130 Jun 02 13:28:30.848695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 466/891] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:30 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:31.009580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:31.010238 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:31.017681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.018114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.018868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.019297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.162148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:31.170357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:31.175369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:31.175369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-21a80c43-3155-4a59-b699-bbc3aecfe1fa tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1597 microversion: 2.20 time: 0.168405 Jun 02 13:28:31.175369 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 426/892] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:28:31 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1597 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:28:31.192505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:31.193098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:31.199252 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.199763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.203502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.203502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.287126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7cfb44a3-7995-491d-a1b4-dd753689737f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098872 Jun 02 13:28:31.287726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 467/893] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Jun 2 13:28:31 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:31.358759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:31.363726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:31.370610 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.371068 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.371852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.372314 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.440973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:31.449422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b4514c39-7ac1-40bc-8680-dd24f80a0786 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1185 microversion: 2.1 time: 0.094584 Jun 02 13:28:31.452045 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 427/894] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:31 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:31.864697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:31.865305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:31.872236 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.872697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.873486 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:31.873901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:31.888661 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] HTTP exception thrown: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Request method failure captured: Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 HTTP/1.1 Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkdoxQVsuRZyzeHL_NlpXhpxZTD16y94iYBpr4-Q4P-xoqoLcyjW0sf7KYmP81SO4hbITem5KItlLKF-dygpP6_kgVyU-NQoIv4pryREPefVHvFt4_AD17v51nmVfGNYCqvPyZpow125_D5S6A4h2sy3VPEf8wgHsaWJE2oimQ-ZpU Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:28:31.890336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dd922c0d796647f8891bf4c5671e4c7b"}]}] Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 5c3f539d6d374fd8b3eaa9e3e22e5cb1 Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. Jun 02 13:28:31.892715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3'} Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:31.893921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. Jun 02 13:28:31.896703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:31.899602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Returning 404 to user: Instance 52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:31.899602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1b08566f-9923-47b2-9459-2299a739b3bc tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3" status: 404 len: 111 microversion: 2.1 time: 0.031546 Jun 02 13:28:31.899602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 468/895] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:31 2022] GET /compute/v2.1/servers/52634d7c-e1d9-46b4-a3a5-1d74dd5b46f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:31.902493 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ea351e78-3111-4ce6-98d2-378644c9a46b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '.version_select at 0x7f5a805835e0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:32.058226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ea351e78-3111-4ce6-98d2-378644c9a46b tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814208614" status: 202 len: 0 microversion: 2.1 time: 0.160648 Jun 02 13:28:32.058964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 428/896] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 2 13:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814208614 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:28:32.395153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-61799df6-26cf-42f1-86ab-b07d7c89b35f req-76b51e02-55dc-4591-adb6-69058086604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:32.404865 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-61799df6-26cf-42f1-86ab-b07d7c89b35f req-76b51e02-55dc-4591-adb6-69058086604a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:32.408726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-61799df6-26cf-42f1-86ab-b07d7c89b35f req-76b51e02-55dc-4591-adb6-69058086604a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:32.418628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-61799df6-26cf-42f1-86ab-b07d7c89b35f req-76b51e02-55dc-4591-adb6-69058086604a service nova] Creating event network-changed:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:28:32.424538 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-61799df6-26cf-42f1-86ab-b07d7c89b35f req-76b51e02-55dc-4591-adb6-69058086604a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033090 Jun 02 13:28:32.425146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 469/897] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:32.476944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:32.477784 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:32.480942 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:32.489429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:32.490138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:32.492472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:32.493070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:32.770333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:32.782331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b647007b-8cb0-4f22-a115-72587d4fd7e0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1203 microversion: 2.1 time: 0.316867 Jun 02 13:28:32.784059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 429/898] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:32 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:33.813265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:33.814065 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:33.821354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:33.821815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:33.822624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:33.823068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:33.987798 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:33.996415 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3de3add0-a9a6-4e20-855a-9ee7708f6442 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.191919 Jun 02 13:28:33.997089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 470/899] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:33 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:34.115434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-07693c12-3b0f-403b-9e7b-de668e7c91e2 req-4a033355-a6ec-4de5-9f70-9c210bdd258a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:34.126412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-07693c12-3b0f-403b-9e7b-de668e7c91e2 req-4a033355-a6ec-4de5-9f70-9c210bdd258a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:34.126938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-07693c12-3b0f-403b-9e7b-de668e7c91e2 req-4a033355-a6ec-4de5-9f70-9c210bdd258a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:34.143624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-07693c12-3b0f-403b-9e7b-de668e7c91e2 req-4a033355-a6ec-4de5-9f70-9c210bdd258a service nova] Creating event network-changed:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:28:34.149133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-07693c12-3b0f-403b-9e7b-de668e7c91e2 req-4a033355-a6ec-4de5-9f70-9c210bdd258a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041694 Jun 02 13:28:34.150418 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 430/900] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:35.014294 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:35.014965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:35.021851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:35.022295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:35.023061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:35.023490 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:35.173747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:35.181953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-389ec9cc-bb06-4599-a1f5-e45f94a34ca1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.171455 Jun 02 13:28:35.182533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 471/901] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:35 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:36.159615 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:36.160296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:36.167707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.170053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.170053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.170053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.194799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:36.200340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:36.202805 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:36.207829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.208303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.209068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.209498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.344311 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:36.352082 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9274b46e-fe74-472d-ad61-2a2c6e87c267 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.156628 Jun 02 13:28:36.352662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 472/902] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:36 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:36.503380 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-28680765-4e3a-496d-8c9b-fda87c35c63d tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 204 len: 0 microversion: 2.1 time: 0.348210 Jun 02 13:28:36.504000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 431/903] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:28:36 2022] DELETE /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:36.512628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:36.513336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:36.519780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.520390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.521166 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:36.521593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:36.907953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:36.915587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ec440ff4-d8ac-4014-baf0-0172ab2498fd tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1508 microversion: 2.1 time: 0.407419 Jun 02 13:28:36.916207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 473/904] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:36 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:37.371213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:37.371943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:37.380525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:37.381251 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:37.382171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:37.382543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:37.614748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:37.624444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d14c3d73-9067-4e63-b490-197df10debe1 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.257380 Jun 02 13:28:37.625038 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 432/905] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:37 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:37.917322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-bc1e98bf-359c-4373-8cb7-f88e977731d7 req-673162e6-dc1b-4b11-a8df-b5b91e1e8a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924c7837-38cd-4d99-bc12-6d1631a6fd43", "name": "network-vif-deleted", "tag": "a385ba1f-8741-43e7-8512-5ec1a8ccf941"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:37.926053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bc1e98bf-359c-4373-8cb7-f88e977731d7 req-673162e6-dc1b-4b11-a8df-b5b91e1e8a9b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:37.929195 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-bc1e98bf-359c-4373-8cb7-f88e977731d7 req-673162e6-dc1b-4b11-a8df-b5b91e1e8a9b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:37.933689 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:37.934306 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:37.938700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-bc1e98bf-359c-4373-8cb7-f88e977731d7 req-673162e6-dc1b-4b11-a8df-b5b91e1e8a9b service nova] Creating event network-vif-deleted:a385ba1f-8741-43e7-8512-5ec1a8ccf941 for instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 on hv-cinder-79760 Jun 02 13:28:37.941464 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:37.942842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:37.943600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-bc1e98bf-359c-4373-8cb7-f88e977731d7 req-673162e6-dc1b-4b11-a8df-b5b91e1e8a9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029967 Jun 02 13:28:37.943743 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:37.944160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:37.947120 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 474/906] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:38.014534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:38.023267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f320e87d-cc73-429c-8082-9c8524f4a4e8 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 200 len: 1466 microversion: 2.1 time: 0.093892 Jun 02 13:28:38.023836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 433/907] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:37 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:38.643524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:38.643524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:38.645201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:38.645893 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:38.650969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:38.657002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:38.657002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:38.657002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:38.790315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:38.800439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5da972a8-33e8-4e6a-a383-19a47339abf5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.161714 Jun 02 13:28:38.801118 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 475/908] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:38 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:39.039632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:39.040304 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 924c7837-38cd-4d99-bc12-6d1631a6fd43] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:39.046595 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.047055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.047804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.048260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.061479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] HTTP exception thrown: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Request method failure captured: Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 HTTP/1.1 Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkdoxQVsuRZyzeHL_NlpXhpxZTD16y94iYBpr4-Q4P-xoqoLcyjW0sf7KYmP81SO4hbITem5KItlLKF-dygpP6_kgVyU-NQoIv4pryREPefVHvFt4_AD17v51nmVfGNYCqvPyZpow125_D5S6A4h2sy3VPEf8wgHsaWJE2oimQ-ZpU Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:28:39.063119 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dd922c0d796647f8891bf4c5671e4c7b"}]}] Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 5c3f539d6d374fd8b3eaa9e3e22e5cb1 Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. Jun 02 13:28:39.064861 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '924c7837-38cd-4d99-bc12-6d1631a6fd43'} Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:39.065802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. Jun 02 13:28:39.067298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:39.068637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Returning 404 to user: Instance 924c7837-38cd-4d99-bc12-6d1631a6fd43 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:39.068637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f9d0e9c-d2be-462c-9386-622cdffff5aa tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43" status: 404 len: 111 microversion: 2.1 time: 0.028850 Jun 02 13:28:39.068637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 434/909] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:39 2022] GET /compute/v2.1/servers/924c7837-38cd-4d99-bc12-6d1631a6fd43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:39.072978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:39.073470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:39.080817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.081273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.082043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.082482 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.109172 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:39.400746 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25631440-b93e-4fb8-b2c1-75a4aef56060 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 204 len: 0 microversion: 2.1 time: 0.331237 Jun 02 13:28:39.408601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 476/910] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:28:39 2022] DELETE /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:39.409233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:39.409839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:39.411815 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:39.416768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.417209 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.417967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.418403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.545352 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:39.552759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8e69708e-60e8-48fc-930d-9905a900be09 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1522 microversion: 2.1 time: 0.147342 Jun 02 13:28:39.553310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 435/911] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:39 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:39.818380 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:39.819081 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:39.825149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.825577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.826337 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:39.826770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:39.961118 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:39.969022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4e1cfc99-3bbc-4ddd-b6ae-3f6b310d65f8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.154938 Jun 02 13:28:39.969581 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 477/912] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:39 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:40.570084 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:40.570691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:40.577362 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:40.577812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:40.579148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:40.583925 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:40.678252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:40.685884 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b473ad0f-3fd2-44c4-80d4-63ce9eecfec4 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1480 microversion: 2.1 time: 0.119667 Jun 02 13:28:40.686461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 436/913] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:40 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1480 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:40.711505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-516ba68d-3020-425a-9cbb-5ea9cc8744c8 req-4c308b83-9195-45c3-9345-b3a83e0f486e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d47700d-bd87-46b1-baae-0c9fb526d72b", "name": "network-vif-deleted", "tag": "9b84ac82-613a-4b00-bcf2-9aeb7ab3b255"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:40.720917 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-516ba68d-3020-425a-9cbb-5ea9cc8744c8 req-4c308b83-9195-45c3-9345-b3a83e0f486e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:40.722495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-516ba68d-3020-425a-9cbb-5ea9cc8744c8 req-4c308b83-9195-45c3-9345-b3a83e0f486e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:40.735283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-516ba68d-3020-425a-9cbb-5ea9cc8744c8 req-4c308b83-9195-45c3-9345-b3a83e0f486e service nova] Creating event network-vif-deleted:9b84ac82-613a-4b00-bcf2-9aeb7ab3b255 for instance 5d47700d-bd87-46b1-baae-0c9fb526d72b on hv-cinder-79760 Jun 02 13:28:40.740194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-516ba68d-3020-425a-9cbb-5ea9cc8744c8 req-4c308b83-9195-45c3-9345-b3a83e0f486e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Jun 02 13:28:40.740870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 478/914] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:40.985164 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:40.986080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:40.992373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:40.992825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:40.993591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:40.994042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:41.138911 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:41.142424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:41.146718 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f4e73a19-7fb3-456f-b061-eec69824f9fe tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.165497 Jun 02 13:28:41.153688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 437/915] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:40 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:41.702783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:41.704221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:41.710634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:41.711076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:41.711827 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:41.712898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:41.717441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:41.746755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:41.747201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:41.747645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'fault' on Instance uuid 5d47700d-bd87-46b1-baae-0c9fb526d72b {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:41.789705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:41.801080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2539361e-41d6-4173-bbbf-49ade41d8a0f tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1312 microversion: 2.1 time: 0.102637 Jun 02 13:28:41.801884 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 479/916] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:41 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:42.163334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:42.163965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:42.170711 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:42.171149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:42.172490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:42.172917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:42.306970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:42.320721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c280c852-853c-4c35-b5f4-723be7247a91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.161592 Jun 02 13:28:42.321316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 438/917] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:42 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:42.818705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:42.819298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:42.826499 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:42.826953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:42.827725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:42.828740 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:42.860766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:42.861269 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:42.861731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lazy-loading 'fault' on Instance uuid 5d47700d-bd87-46b1-baae-0c9fb526d72b {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:42.905821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3f539d6d374fd8b3eaa9e3e22e5cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd922c0d796647f8891bf4c5671e4c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:42.914894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6be8769b-d1dc-47e1-9154-f992cdccf161 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 200 len: 1312 microversion: 2.1 time: 0.100499 Jun 02 13:28:42.915474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 480/918] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:42 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:43.337676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:43.338283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:43.344826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:43.345269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:43.346024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:43.346454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:43.480965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:43.489120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4811905d-58a0-4e27-8e2e-25ce4cbe6d5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.155640 Jun 02 13:28:43.489691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 439/919] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:43 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:43.931730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:43.932372 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] [instance: 5d47700d-bd87-46b1-baae-0c9fb526d72b] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:43.938877 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:43.939327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:43.940113 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:43.940544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:43.953992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] HTTP exception thrown: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Request method failure captured: Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b HTTP/1.1 Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkdoxQVsuRZyzeHL_NlpXhpxZTD16y94iYBpr4-Q4P-xoqoLcyjW0sf7KYmP81SO4hbITem5KItlLKF-dygpP6_kgVyU-NQoIv4pryREPefVHvFt4_AD17v51nmVfGNYCqvPyZpow125_D5S6A4h2sy3VPEf8wgHsaWJE2oimQ-ZpU Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:28:43.955564 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dd922c0d796647f8891bf4c5671e4c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dd922c0d796647f8891bf4c5671e4c7b"}]}] Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: dd922c0d796647f8891bf4c5671e4c7b Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-823048531 Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 5c3f539d6d374fd8b3eaa9e3e22e5cb1 Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-823048531-project Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. Jun 02 13:28:43.956918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '5d47700d-bd87-46b1-baae-0c9fb526d72b'} Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:43.957802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. Jun 02 13:28:43.959536 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:43.961013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] Returning 404 to user: Instance 5d47700d-bd87-46b1-baae-0c9fb526d72b could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:43.961013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-85c6be5d-eeb6-441d-82db-1635d550a323 tempest-ServerRescueNegativeTestJSON-823048531 tempest-ServerRescueNegativeTestJSON-823048531-project] 10.222.0.46 "GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b" status: 404 len: 111 microversion: 2.1 time: 0.029169 Jun 02 13:28:43.961013 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 481/920] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:43 2022] GET /compute/v2.1/servers/5d47700d-bd87-46b1-baae-0c9fb526d72b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:44.506899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:44.507514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:44.514107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:44.514553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:44.515317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:44.515749 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:44.772390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:44.782915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5e024fd9-97a4-4685-9e6e-a9b8a03bcbd0 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.279971 Jun 02 13:28:44.787715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 440/921] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:44 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:45.800016 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:45.801235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:45.808397 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:45.809208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:45.809986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:45.810423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:45.962729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:45.971146 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-739361ed-7e7b-46d0-943c-a428a5db7688 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.174999 Jun 02 13:28:45.971978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 482/922] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:45 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:46.988322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:46.988946 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:47.003132 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:47.003586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:47.004438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:47.005056 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:47.200729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-a525c724-69d2-4bb2-990b-54dbe104e207 req-dfa62390-2132-4acb-baf9-46418772e1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "name": "network-vif-plugged", "status": "completed", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:47.211422 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a525c724-69d2-4bb2-990b-54dbe104e207 req-dfa62390-2132-4acb-baf9-46418772e1d1 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:47.212309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a525c724-69d2-4bb2-990b-54dbe104e207 req-dfa62390-2132-4acb-baf9-46418772e1d1 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:47.224354 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-a525c724-69d2-4bb2-990b-54dbe104e207 req-dfa62390-2132-4acb-baf9-46418772e1d1 service nova] Creating event network-vif-plugged:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:28:47.229598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-a525c724-69d2-4bb2-990b-54dbe104e207 req-dfa62390-2132-4acb-baf9-46418772e1d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Jun 02 13:28:47.230556 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 483/923] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:28:47.232263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:47.240280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a6b5afdf-380a-488a-be8f-27d272ad2ed8 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.256471 Jun 02 13:28:47.241078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 441/924] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:46 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:48.258586 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:48.258984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:48.266194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:48.266637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:48.267398 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:48.268049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:48.407882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:48.415377 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f33c5a19-97c8-49c1-a928-8b6f16164839 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.161457 Jun 02 13:28:48.415959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 484/925] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:48 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:48.990176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:48.991216 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:48.997715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:48.998160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:48.998915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:48.999354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.031154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ec8cc2cc-8bd4-47ee-8601-676c9df51f98 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044890 Jun 02 13:28:49.036667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 442/926] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:48 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:28:49.091727 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:49.092251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:49.099248 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.101114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.101114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.101114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.127657 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:49.372389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fe00fcd1-5319-4c0f-9e5a-f101ceb21d66 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 204 len: 0 microversion: 2.1 time: 0.284203 Jun 02 13:28:49.372999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 485/927] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:28:49 2022] DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:49.381241 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:49.381885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:49.388195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.388648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.389418 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.389860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.432906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:49.433751 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:49.440111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.440567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.441347 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:49.441785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:49.550351 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:49.560520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3809a38e-95db-4827-88b6-adb5b5f574a6 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1673 microversion: 2.1 time: 0.182743 Jun 02 13:28:49.570537 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 443/928] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:49 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:49.599404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:49.607263 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aa80a344-3591-45ea-a617-653cdff157b3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1258 microversion: 2.1 time: 0.178754 Jun 02 13:28:49.608129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 486/929] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:49 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:49.910514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ebe9d6d2-7723-4c4e-865f-69643cc627e7 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Action: 'create', calling method: .version_select at 0x7f5a804cf430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-546239026", "metadata": {"Type": "work"}}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:50.495042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ebe9d6d2-7723-4c4e-865f-69643cc627e7 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.698014 Jun 02 13:28:50.495665 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 444/930] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 2 13:28:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 13:28:50.507249 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aaaa3bc7-ad30-4937-b52e-b95296710ad0 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a82ce60d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:50.554966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aaaa3bc7-ad30-4937-b52e-b95296710ad0 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 200 len: 352 microversion: 2.1 time: 0.051613 Jun 02 13:28:50.555573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 487/931] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:28:50 2022] GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:50.577601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:50.578443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:50.585088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.585538 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:50.586301 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.586732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:50.623414 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:50.624171 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:50.630776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.631305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:50.632228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.632726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:50.724102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:50.732262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2ae41032-f2eb-47fd-ac49-1c189cff8fb4 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1673 microversion: 2.1 time: 0.158411 Jun 02 13:28:50.732837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 445/932] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:50 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:50.770015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:50.777587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-59d19bbc-0b27-4cd1-a27a-23f8e78d24ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1443 microversion: 2.1 time: 0.158066 Jun 02 13:28:50.778156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 488/933] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:50 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:50.793327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:50.793937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:50.800266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.800746 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:50.801550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:50.801988 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:51.022448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:51.030030 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cf7e7e17-4580-4d6a-9d32-2e8d2f16980d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1443 microversion: 2.1 time: 0.240503 Jun 02 13:28:51.031664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 446/934] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:50 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1443 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:51.567223 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f8e38ed9-c130-4d46-bf18-c3f0a16a8d99 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a8563ddc0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:51.616188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f8e38ed9-c130-4d46-bf18-c3f0a16a8d99 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 200 len: 353 microversion: 2.1 time: 0.052678 Jun 02 13:28:51.616719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 489/935] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:51.627893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5abe66b9-73b4-4822-bd5d-111c0623c768 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a8066c0d0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:51.678078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5abe66b9-73b4-4822-bd5d-111c0623c768 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 200 len: 353 microversion: 2.1 time: 0.053729 Jun 02 13:28:51.678922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 447/936] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:51.695303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3f0be46c-3a75-4e49-a017-418d45b60d66 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a73824820>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:51.751218 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:51.751885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:51.758138 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:51.758591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:51.759496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:51.760204 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:51.857834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:51.866907 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ba2d80ab-b883-46dd-b976-6673fd1ca408 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1605 microversion: 2.1 time: 0.120074 Jun 02 13:28:51.868000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 448/937] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:51.873078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-e160986f-11cb-4db1-8f4d-84cc5cff9c6c req-c747cbe6-976c-4bdb-a3f2-f760e9bdfdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e59264d-5544-48cd-a508-5c7b119cfeae", "name": "network-vif-deleted", "tag": "1b1f8072-eaa6-4034-99a8-a965c894139b"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:51.883622 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e160986f-11cb-4db1-8f4d-84cc5cff9c6c req-c747cbe6-976c-4bdb-a3f2-f760e9bdfdab service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:51.886395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e160986f-11cb-4db1-8f4d-84cc5cff9c6c req-c747cbe6-976c-4bdb-a3f2-f760e9bdfdab service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:51.900113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-e160986f-11cb-4db1-8f4d-84cc5cff9c6c req-c747cbe6-976c-4bdb-a3f2-f760e9bdfdab service nova] Creating event network-vif-deleted:1b1f8072-eaa6-4034-99a8-a965c894139b for instance 1e59264d-5544-48cd-a508-5c7b119cfeae on hv-cinder-79760 Jun 02 13:28:51.908605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-e160986f-11cb-4db1-8f4d-84cc5cff9c6c req-c747cbe6-976c-4bdb-a3f2-f760e9bdfdab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036630 Jun 02 13:28:51.909577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 449/938] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:51.944390 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3f0be46c-3a75-4e49-a017-418d45b60d66 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 202 len: 0 microversion: 2.1 time: 0.252909 Jun 02 13:28:51.945482 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 490/939] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:28:51 2022] DELETE /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:28:51.954749 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-07018e41-cc53-41cd-9c7c-c8825b7e7ec2 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a73824d30>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:52.056450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-07018e41-cc53-41cd-9c7c-c8825b7e7ec2 tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 200 len: 352 microversion: 2.1 time: 0.103846 Jun 02 13:28:52.059138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 491/940] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:52.128987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2034781198"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:52.129633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:52.142248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:52.142248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:52.142248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:52.142248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:52.306682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.network.security_group_api [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Removing security group 406aeda2-0e63-436e-8511-456215fb40c9 from port 9e20201d-c908-4fe2-b7fc-b6260847a07e Jun 02 13:28:52.844266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dd850754-f703-4be5-9ef2-8f9c13317d65 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action" status: 202 len: 0 microversion: 2.1 time: 0.932442 Jun 02 13:28:52.848425 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 450/941] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:28:51 2022] POST /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/action => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:28:52.886619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:52.887781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:52.897771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:52.903407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:52.904340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:52.905157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:52.974268 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:52.975008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:52.975622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lazy-loading 'fault' on Instance uuid 1e59264d-5544-48cd-a508-5c7b119cfeae {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:53.048857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:53.064505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a4c5c4a5-0a44-4be9-a93c-ebc2ac75bcfe tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 200 len: 1326 microversion: 2.1 time: 0.183649 Jun 02 13:28:53.065407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 492/942] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:52 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:53.066674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2270f6f8-3a1a-4d9e-9522-c6316bd9f96d tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Calling method '.version_select at 0x7f5a80620040>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:53.101475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-2270f6f8-3a1a-4d9e-9522-c6316bd9f96d tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] HTTP exception thrown: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2270f6f8-3a1a-4d9e-9522-c6316bd9f96d tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Request method failure captured: Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e HTTP/1.1 Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLsRhqhCYR-7m3Ydo_Wk1hKCL_9x9TIzrOjniZQivf8ebpAvxCGI57ST3EM8Yew0YGscs0qvOtA3v9ThVQ3GlNzcGE5WTiDHhQuubsxtmzbUcRUyRdyGuwUwDN-wHMUElJufpHQlC3Xq4U1DDuX1u89kQH0liZzwwUz_SKtsHZbUy0Y Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 8df964527b854123bccbe202b7b7679c Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesGetTestJSON-880557662 Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:28:53.103820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8df964527b854123bccbe202b7b7679c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8df964527b854123bccbe202b7b7679c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8df964527b854123bccbe202b7b7679c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8df964527b854123bccbe202b7b7679c"}]}] Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesGetTestJSON-880557662 Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 8df964527b854123bccbe202b7b7679c Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesGetTestJSON-880557662 Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesGetTestJSON-880557662-project Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 4ca8df461be849bea18f6f52d1339dd8 Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesGetTestJSON-880557662-project Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'ba424655-06a2-4973-b2bd-1fedd4aa824e'} Jun 02 13:28:53.105417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. (HTTP 404) (Request-ID: req-da058a55-a53a-456e-92ba-9de2455562d5) Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:53.106438 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:28:53.107858 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:28:53.115551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2270f6f8-3a1a-4d9e-9522-c6316bd9f96d tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] Returning 404 to user: Volume ba424655-06a2-4973-b2bd-1fedd4aa824e could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2270f6f8-3a1a-4d9e-9522-c6316bd9f96d tempest-VolumesGetTestJSON-880557662 tempest-VolumesGetTestJSON-880557662-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e" status: 404 len: 109 microversion: 2.1 time: 0.048669 Jun 02 13:28:53.116867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 451/943] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:28:53 2022] GET /compute/v2.1/os-volumes/ba424655-06a2-4973-b2bd-1fedd4aa824e => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:53.730582 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-1ce529ca-9bd8-4335-8207-730589a7e0aa req-13200ec9-d336-4d08-9d10-6947c48b6e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:53.740845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1ce529ca-9bd8-4335-8207-730589a7e0aa req-13200ec9-d336-4d08-9d10-6947c48b6e85 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:53.741295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1ce529ca-9bd8-4335-8207-730589a7e0aa req-13200ec9-d336-4d08-9d10-6947c48b6e85 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:53.756898 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-1ce529ca-9bd8-4335-8207-730589a7e0aa req-13200ec9-d336-4d08-9d10-6947c48b6e85 service nova] Creating event network-changed:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:28:53.763960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-1ce529ca-9bd8-4335-8207-730589a7e0aa req-13200ec9-d336-4d08-9d10-6947c48b6e85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036141 Jun 02 13:28:53.771208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 493/944] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:53.929589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-00ed47fc-d6af-4636-a7c6-aaf8ec96b7d3 req-51cf6a9f-8148-4d5a-866f-43c069094b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:53.941495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-00ed47fc-d6af-4636-a7c6-aaf8ec96b7d3 req-51cf6a9f-8148-4d5a-866f-43c069094b5f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:53.942102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-00ed47fc-d6af-4636-a7c6-aaf8ec96b7d3 req-51cf6a9f-8148-4d5a-866f-43c069094b5f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:53.954664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-00ed47fc-d6af-4636-a7c6-aaf8ec96b7d3 req-51cf6a9f-8148-4d5a-866f-43c069094b5f service nova] Creating event network-changed:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:28:53.960136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-00ed47fc-d6af-4636-a7c6-aaf8ec96b7d3 req-51cf6a9f-8148-4d5a-866f-43c069094b5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Jun 02 13:28:53.961044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 452/945] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:54.083684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:54.084852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:54.093610 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:54.094063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:54.094862 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:54.095983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:54.127839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae HTTP/1.1 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:28:54.130164 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:28:54.131840 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '1e59264d-5544-48cd-a508-5c7b119cfeae'} Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:54.132885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:28:54.134389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:28:54.137417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:54.138526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-81624536-55b9-4ffb-9615-c459d08f9a84 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 404 len: 111 microversion: 2.1 time: 0.059664 Jun 02 13:28:54.142548 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 494/946] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:54 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:54.149328 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8a5dd199-a702-4d09-a7db-78200dd71530 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '.version_select at 0x7f5a80406f70>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:54.253611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8a5dd199-a702-4d09-a7db-78200dd71530 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525965325" status: 202 len: 0 microversion: 2.1 time: 0.109007 Jun 02 13:28:54.254983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 453/947] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 2 13:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525965325 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:28:55.470767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:55.471386 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:55.486133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:55.486852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:55.488096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:55.488760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:55.511989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5fd4f5e4-c8f6-411d-b1de-fa2f135a6589 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: .version_select at 0x7f5a805835e0>, body: {"keypair": {"name": "tempest-keypair-411426798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAybUgvF0dMogKsxauESscQ8yGIWXGfA3/1rQQpo32vrCqYNTHmu1Qvaf9XKRKQqFKbtxLt6u/xnFkzlHURyyezIXIBIYGSs8QzzJDzSAjt9byB2VAOPTVlI0ZgMEeX5VQ=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:55.530002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-5fd4f5e4-c8f6-411d-b1de-fa2f135a6589 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:28:55.534527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-5fd4f5e4-c8f6-411d-b1de-fa2f135a6589 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for user a99a2ba62f3948e99f6e78cabade3685 and project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:28:55.586498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lazy-loading 'services' on Instance uuid 2177c694-cb9e-42ab-aefa-5f9c52541c30 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:28:55.628158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5fd4f5e4-c8f6-411d-b1de-fa2f135a6589 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116498 Jun 02 13:28:55.628158 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 454/948] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:55.858474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-895d3c02-b1a8-4cce-8bd9-22586b4a228c tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments/18974cb1-7480-40fd-8f8b-b5fbc86491f4" status: 202 len: 0 microversion: 2.1 time: 0.393276 Jun 02 13:28:55.859201 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 495/949] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:28:55 2022] DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments/18974cb1-7480-40fd-8f8b-b5fbc86491f4 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:28:55.870552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:55.871603 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:55.878514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:55.879046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:55.879970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:55.880430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:55.912690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ce938848-de9a-4f91-bf70-da4ac2c3bc58 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Jun 02 13:28:55.913375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 455/950] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:55 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:56.006550 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-b58d21b2-23ac-4f7f-8178-d8adca29a31b req-34e0c621-e759-4af0-9b9b-5bbe1b85f3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:56.015176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b58d21b2-23ac-4f7f-8178-d8adca29a31b req-34e0c621-e759-4af0-9b9b-5bbe1b85f3cc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:56.015669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b58d21b2-23ac-4f7f-8178-d8adca29a31b req-34e0c621-e759-4af0-9b9b-5bbe1b85f3cc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:56.027155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-b58d21b2-23ac-4f7f-8178-d8adca29a31b req-34e0c621-e759-4af0-9b9b-5bbe1b85f3cc service nova] Creating event network-changed:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:28:56.033358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-b58d21b2-23ac-4f7f-8178-d8adca29a31b req-34e0c621-e759-4af0-9b9b-5bbe1b85f3cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030443 Jun 02 13:28:56.033957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 496/951] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:56.926317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:56.927252 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:56.940937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:56.941745 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:56.942704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:56.943523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:56.979126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9e26c00e-d848-48d8-86b9-cebb9d598039 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057387 Jun 02 13:28:56.980339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 456/952] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:56 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:57.994821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:57.995826 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:58.002488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.002970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.005849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.005849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.033776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aa81687a-02b1-4ba6-8396-8bad25972496 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043792 Jun 02 13:28:58.034328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 497/953] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:28:57 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:28:58.044269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:58.046057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:58.051232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.051674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.052477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.052915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.137580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] HTTP exception thrown: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 is not attached to volume 18974cb1-7480-40fd-8f8b-b5fbc86491f4 Jun 02 13:28:58.148221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1985784565", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "695fac8a-ad9b-4f70-8314-c863cffa2edb"}], "security_groups": [{"name": "tempest-securitygroup--1411975045"}], "key_name": "tempest-keypair-411426798", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Request method failure captured: Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments/18974cb1-7480-40fd-8f8b-b5fbc86491f4 HTTP/1.1 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLm8pDmCuiWh0YooHevi96etVL7R44byMLe_uGetkgU1gwYI5Rp4KpJnCeAXnIpkY-DPvby9cHWU4rmCiejXjW4uvQ-Vx6pKYKtHPzKhSIAC3g8cghfH3_zpoZtvT1l1Rtey2fOb9j44v3vYetpx0bOuj8ggzvTOVOqYNtNGU302eUI Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 81684485980545cda977f1d7e72f90e2 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:28:58.157242 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/81684485980545cda977f1d7e72f90e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/81684485980545cda977f1d7e72f90e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/81684485980545cda977f1d7e72f90e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_81684485980545cda977f1d7e72f90e2"}]}] Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 81684485980545cda977f1d7e72f90e2 Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-TestMinimumBasicScenario-1068539577-project Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: fac722ebafd540b0b3fe05d83fa39c36 Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestMinimumBasicScenario-1068539577-project Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:28:58.158944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 is not attached to volume 18974cb1-7480-40fd-8f8b-b5fbc86491f4 Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'server_id': '2177c694-cb9e-42ab-aefa-5f9c52541c30', 'id': '18974cb1-7480-40fd-8f8b-b5fbc86491f4'} Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 18974cb1-7480-40fd-8f8b-b5fbc86491f4. Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:28:58.159792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 is not attached to volume 18974cb1-7480-40fd-8f8b-b5fbc86491f4 Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 is not attached to volume 18974cb1-7480-40fd-8f8b-b5fbc86491f4 Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:28:58.161170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Returning 404 to user: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 is not attached to volume 18974cb1-7480-40fd-8f8b-b5fbc86491f4 {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:28:58.162317 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2b8d3d3d-03d0-40ba-9fd0-2f6a26973bc3 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments/18974cb1-7480-40fd-8f8b-b5fbc86491f4" status: 404 len: 154 microversion: 2.1 time: 0.120772 Jun 02 13:28:58.162893 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 457/954] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:28:58 2022] DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30/os-volume_attachments/18974cb1-7480-40fd-8f8b-b5fbc86491f4 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:28:58.258639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] validate_networks() for [('695fac8a-ad9b-4f70-8314-c863cffa2edb', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:28:58.628173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:28:58.628715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:28:58.635116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:28:58.635116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:28:58.635116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:28:58.639908 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.640989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.641875 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:58.642401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:58.660276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:28:58.664442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Getting quotas for user a99a2ba62f3948e99f6e78cabade3685 and project 907c2f17d46e4ebd974386bc7fae2fc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:28:58.676060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:28:58.678833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:28:58.882974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7526a904-40dc-46de-b168-8fef7d6eecc8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739017 Jun 02 13:28:58.883623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 498/955] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:28:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:28:58.894354 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-041c07ab-012a-4027-960c-c71b2b9d1bbb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:58.895121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-041c07ab-012a-4027-960c-c71b2b9d1bbb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:58.951423 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-041c07ab-012a-4027-960c-c71b2b9d1bbb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:28:58.959967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-041c07ab-012a-4027-960c-c71b2b9d1bbb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1237 microversion: 2.1 time: 0.069903 Jun 02 13:28:58.970059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 458/956] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:58 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:59.467836 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:59.468374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:59.475027 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.475479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:59.476280 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.476897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:59.503738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:28:59.530186 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:59.745475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:59.875156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-72d8ce50-a1f8-4a62-97af-7c513e30ef9f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 204 len: 0 microversion: 2.1 time: 0.411358 Jun 02 13:28:59.875774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 499/957] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:28:59 2022] DELETE /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:28:59.884572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:59.885195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:59.891507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.891983 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:59.892932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.893374 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:59.978686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:59.979420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:28:59.985729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.986213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:28:59.986991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:28:59.987426 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:00.051815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:00.071122 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:00.071962 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ead380f-e015-4c89-867a-014978641476 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1241 microversion: 2.1 time: 0.098552 Jun 02 13:29:00.072748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 500/958] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:59 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:00.080300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6842b102-2897-4c23-a423-9f5a703aadf0 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1553 microversion: 2.1 time: 0.200072 Jun 02 13:29:00.090504 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 459/959] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:28:59 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:01.089886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:01.090493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:01.098330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:01.098871 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:01.099023 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:01.099128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:01.099709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:01.100176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:01.105637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:01.106027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:01.106795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:01.107232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:01.173443 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:01.182317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5fb3c26e-c6ca-46e1-89a8-979897d1861f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1241 microversion: 2.1 time: 0.096839 Jun 02 13:29:01.183921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 501/960] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:01 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:01.258310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:01.266365 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-214e0ea6-7422-4426-8f32-8032d45b4ed1 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1553 microversion: 2.1 time: 0.171925 Jun 02 13:29:01.266931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 460/961] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:01 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:02.200358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:02.200950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:02.208927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:02.209379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:02.210349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:02.210785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:02.275853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:02.282970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:02.283791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:02.287809 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3e1f9c71-9b84-45cb-a880-cdbabecef826 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1289 microversion: 2.1 time: 0.091239 Jun 02 13:29:02.290849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 502/962] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:02 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:02.291002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:02.291235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:02.292287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:02.292717 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:02.535237 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:02.544244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e864d118-8f13-4ad0-bdcc-5c320f4268ed tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1553 microversion: 2.1 time: 0.265365 Jun 02 13:29:02.554156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 461/963] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:02 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:02.979272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-0f4bc014-7444-4793-b7df-ce21b7ccd934 req-115bbdc3-efb5-496f-aae5-798f610547a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177c694-cb9e-42ab-aefa-5f9c52541c30", "name": "network-vif-deleted", "tag": "9e20201d-c908-4fe2-b7fc-b6260847a07e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:02.992141 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-0f4bc014-7444-4793-b7df-ce21b7ccd934 req-115bbdc3-efb5-496f-aae5-798f610547a0 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:02.992729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-0f4bc014-7444-4793-b7df-ce21b7ccd934 req-115bbdc3-efb5-496f-aae5-798f610547a0 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.003844 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-0f4bc014-7444-4793-b7df-ce21b7ccd934 req-115bbdc3-efb5-496f-aae5-798f610547a0 service nova] Creating event network-vif-deleted:9e20201d-c908-4fe2-b7fc-b6260847a07e for instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 on hv-cinder-79760 Jun 02 13:29:03.009085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-0f4bc014-7444-4793-b7df-ce21b7ccd934 req-115bbdc3-efb5-496f-aae5-798f610547a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Jun 02 13:29:03.013287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 503/964] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:03.308323 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:03.309844 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:03.319845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:03.320240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.321089 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:03.321582 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.328445 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:03.401543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:03.418443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fd6d396d-033a-4f89-8522-966b98eb761f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1295 microversion: 2.1 time: 0.116415 Jun 02 13:29:03.419333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 462/965] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:03 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:03.562378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:03.563608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:03.576162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:03.576610 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.577388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:03.578398 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.612989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:03.613560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:03.614084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lazy-loading 'fault' on Instance uuid 2177c694-cb9e-42ab-aefa-5f9c52541c30 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:29:03.684585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac722ebafd540b0b3fe05d83fa39c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81684485980545cda977f1d7e72f90e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:03.707320 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fb800a62-002d-4f2f-a720-f0bb6ec8e09e tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 200 len: 1346 microversion: 2.1 time: 0.149499 Jun 02 13:29:03.708246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 504/966] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:03 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:04.437286 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:04.437913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:04.446042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:04.446494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:04.447268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:04.447703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:04.592722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:04.600814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8cf3a02-0dcb-4ef4-ab63-af87a8bb513d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.168160 Jun 02 13:29:04.601390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 463/967] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:04 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:04.646358 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e7518bd3-9fa1-4a74-b6cb-7b09cc2254ad req-25444076-7dd7-4474-a302-bcd376db0bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd57b3c0-c014-4315-8151-9b71ea242990", "tag": "c34e0ea9-afe9-4b4c-aa06-12b5c42fabff"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:04.655719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e7518bd3-9fa1-4a74-b6cb-7b09cc2254ad req-25444076-7dd7-4474-a302-bcd376db0bb1 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:04.656954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e7518bd3-9fa1-4a74-b6cb-7b09cc2254ad req-25444076-7dd7-4474-a302-bcd376db0bb1 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:04.668467 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e7518bd3-9fa1-4a74-b6cb-7b09cc2254ad req-25444076-7dd7-4474-a302-bcd376db0bb1 service nova] Creating event network-changed:c34e0ea9-afe9-4b4c-aa06-12b5c42fabff for instance cd57b3c0-c014-4315-8151-9b71ea242990 on hv-cinder-79760 Jun 02 13:29:04.673314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e7518bd3-9fa1-4a74-b6cb-7b09cc2254ad req-25444076-7dd7-4474-a302-bcd376db0bb1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Jun 02 13:29:04.674336 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 505/968] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:29:04.725449 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:04.726065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] [instance: 2177c694-cb9e-42ab-aefa-5f9c52541c30] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:04.733809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:04.734892 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:04.735721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:04.737493 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:04.755623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] HTTP exception thrown: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Request method failure captured: Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 HTTP/1.1 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLm8pDmCuiWh0YooHevi96etVL7R44byMLe_uGetkgU1gwYI5Rp4KpJnCeAXnIpkY-DPvby9cHWU4rmCiejXjW4uvQ-Vx6pKYKtHPzKhSIAC3g8cghfH3_zpoZtvT1l1Rtey2fOb9j44v3vYetpx0bOuj8ggzvTOVOqYNtNGU302eUI Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 81684485980545cda977f1d7e72f90e2 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:29:04.758128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/81684485980545cda977f1d7e72f90e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/81684485980545cda977f1d7e72f90e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/81684485980545cda977f1d7e72f90e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_81684485980545cda977f1d7e72f90e2"}]}] Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 81684485980545cda977f1d7e72f90e2 Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1068539577 Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-TestMinimumBasicScenario-1068539577-project Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: fac722ebafd540b0b3fe05d83fa39c36 Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestMinimumBasicScenario-1068539577-project Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. Jun 02 13:29:04.768414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '2177c694-cb9e-42ab-aefa-5f9c52541c30'} Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:04.769554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. Jun 02 13:29:04.770722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:29:04.771801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Returning 404 to user: Instance 2177c694-cb9e-42ab-aefa-5f9c52541c30 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:04.771801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-606ae2f3-7bd8-4db5-b238-09c4ae27dd31 tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30" status: 404 len: 111 microversion: 2.1 time: 0.038281 Jun 02 13:29:04.771801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 464/969] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:04 2022] GET /compute/v2.1/servers/2177c694-cb9e-42ab-aefa-5f9c52541c30 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:29:04.775615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4eb7db77-2e45-4948-b722-1ec775d0459f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] Calling method '.version_select at 0x7f5a7382f9d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:04.888144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4eb7db77-2e45-4948-b722-1ec775d0459f tempest-TestMinimumBasicScenario-1068539577 tempest-TestMinimumBasicScenario-1068539577-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-75463125" status: 202 len: 0 microversion: 2.1 time: 0.117172 Jun 02 13:29:04.890941 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 506/970] 10.222.0.46 () {58 vars in 1265 bytes} [Thu Jun 2 13:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-75463125 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:29:05.617407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:05.618022 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:05.625139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:05.625593 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:05.626366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:05.626859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:05.758500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:05.767052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c5380546-efb9-423b-b883-2da98934fb9f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.153502 Jun 02 13:29:05.767617 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 465/971] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:05 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:06.785525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:06.786268 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:06.792896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:06.793401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:06.794179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:06.794621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:07.017727 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:07.025522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8b3c5cfb-c059-4067-b9bf-55621e26a71c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.244896 Jun 02 13:29:07.026099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 507/972] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:06 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:08.042860 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:08.043395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:08.045718 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:08.051239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:08.051685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:08.052474 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:08.052910 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:08.189976 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:08.198079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dbf2c931-71e1-48fd-82a0-4efe171f410d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.159111 Jun 02 13:29:08.198751 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 466/973] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:08 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:09.216624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:09.217906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:09.220710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:09.221797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:09.235319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:09.235828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:09.237342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:09.237833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:09.413576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:09.422131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fd86b620-b9b6-497d-920a-444288a9d6de tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.209384 Jun 02 13:29:09.423051 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 508/974] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:09 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:10.442028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:10.447015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:10.447623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:10.454127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:10.454772 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:10.455542 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:10.456014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:10.629413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:10.637461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c442757b-1866-4eda-a7fc-fd97cf15231a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.197958 Jun 02 13:29:10.638373 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 467/975] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:10 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:11.347370 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-8408f3ed-f382-46ee-a632-f716f5396c6c req-10820536-0ddf-4cf2-be92-b22900f17c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd57b3c0-c014-4315-8151-9b71ea242990", "name": "network-vif-plugged", "status": "completed", "tag": "c34e0ea9-afe9-4b4c-aa06-12b5c42fabff"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:11.356476 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-8408f3ed-f382-46ee-a632-f716f5396c6c req-10820536-0ddf-4cf2-be92-b22900f17c6b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:11.357001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-8408f3ed-f382-46ee-a632-f716f5396c6c req-10820536-0ddf-4cf2-be92-b22900f17c6b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:11.368202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-8408f3ed-f382-46ee-a632-f716f5396c6c req-10820536-0ddf-4cf2-be92-b22900f17c6b service nova] Creating event network-vif-plugged:c34e0ea9-afe9-4b4c-aa06-12b5c42fabff for instance cd57b3c0-c014-4315-8151-9b71ea242990 on hv-cinder-79760 Jun 02 13:29:11.373107 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-8408f3ed-f382-46ee-a632-f716f5396c6c req-10820536-0ddf-4cf2-be92-b22900f17c6b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Jun 02 13:29:11.373728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 509/976] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:11.654544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:11.655824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:11.663199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:11.663661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:11.664470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:11.664914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:11.818733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:11.829732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ce5d3cae-c888-434f-98b6-c3e0d8a3da72 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.178982 Jun 02 13:29:11.830316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 468/977] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:11 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:12.849050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:12.850449 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:12.860344 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:12.861034 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:12.862018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:12.862927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:13.091356 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:13.102242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-281233ff-b528-4a42-9ceb-6349fbd34a65 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1363 microversion: 2.1 time: 0.259238 Jun 02 13:29:13.111946 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 510/978] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:12 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:14.119477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:14.120153 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:14.127447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:14.128086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:14.129706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:14.129706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:14.279792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:29:14.297533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-68634ffe-8e1e-46c3-8cea-e408b52d485d tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1549 microversion: 2.1 time: 0.181337 Jun 02 13:29:14.303978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 469/979] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:29:14 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:14.316118 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:14.316708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:14.328876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:14.329518 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:14.330357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:14.330801 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:14.494463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-56ae9984-9bce-42b7-8c8a-9831aa6d0722 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181741 Jun 02 13:29:14.495262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 511/980] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:29:14 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:15.622886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-46907c5b-f26c-4487-acc9-8c4852bd8668 req-0dfca6a5-bdb3-475b-9176-fb55a9c91219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd57b3c0-c014-4315-8151-9b71ea242990", "tag": "c34e0ea9-afe9-4b4c-aa06-12b5c42fabff"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:15.634668 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-46907c5b-f26c-4487-acc9-8c4852bd8668 req-0dfca6a5-bdb3-475b-9176-fb55a9c91219 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:15.635115 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-46907c5b-f26c-4487-acc9-8c4852bd8668 req-0dfca6a5-bdb3-475b-9176-fb55a9c91219 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:15.649601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-46907c5b-f26c-4487-acc9-8c4852bd8668 req-0dfca6a5-bdb3-475b-9176-fb55a9c91219 service nova] Creating event network-changed:c34e0ea9-afe9-4b4c-aa06-12b5c42fabff for instance cd57b3c0-c014-4315-8151-9b71ea242990 on hv-cinder-79760 Jun 02 13:29:15.656077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-46907c5b-f26c-4487-acc9-8c4852bd8668 req-0dfca6a5-bdb3-475b-9176-fb55a9c91219 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Jun 02 13:29:15.656776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 470/981] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:59.389861 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:59.390706 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:59.394718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:59.395212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:29:59.405331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:59.405331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:59.405331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:29:59.405331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:29:59.426121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5dc11668-09e5-465d-be20-13fd255a09f8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/ips" status: 200 len: 151 microversion: 2.20 time: 0.038330 Jun 02 13:29:59.426690 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 512/982] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Jun 2 13:29:59 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:30:02.685095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=9 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.686371 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=44 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.690624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:02.691236 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:02.697251 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:02.699575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:02.699575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:02.699575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:02.721432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lazy-loading 'flavor' on Instance uuid 36f55ba0-d5a3-4df2-90aa-458eea757132 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:30:03.285239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-17cbd117-f41a-462c-9b48-60f8763755db tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/action" status: 202 len: 0 microversion: 2.20 time: 0.601542 Jun 02 13:30:03.285793 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 471/983] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 2 13:30:02 2022] POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:30:03.294168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:03.294779 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:03.302949 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:03.303411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:03.304290 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:03.304767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:03.442155 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:03.451098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:03.453374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:03.454558 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eefe2486-8987-4ecb-908b-780277c69554 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.164342 Jun 02 13:30:03.455480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 513/984] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:03 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:04.474017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:04.474735 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:04.481057 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:04.481503 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:04.482258 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:04.482692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:04.613616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:04.621546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:04.623092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:04.624297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-81036b0e-ee1a-4619-a9ef-5eaa2a2be4f0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.154993 Jun 02 13:30:04.624853 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 472/985] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:04 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:05.642778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:05.643407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:05.650520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:05.650905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:05.651668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:05.652124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:05.782444 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:05.790327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:05.791829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:05.793020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9ebc379d-54b9-48f5-9e67-14ca326bb9fd tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.154895 Jun 02 13:30:05.793571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 514/986] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:05 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:06.812092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:06.812768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:06.819234 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:06.819682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:06.820480 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:06.820917 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:06.948200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:06.956390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:06.957881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:06.959077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-484d03ec-5355-49e4-ba46-f25878f0c8f7 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.151590 Jun 02 13:30:06.959636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 473/987] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:06 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:07.977331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:07.977969 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:07.984502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:07.984944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:07.985702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:07.986132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:08.119771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:08.128454 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:08.129986 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:08.131187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f8f33e5d-c2c6-470d-9b45-327a39d10faf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.157876 Jun 02 13:30:08.131767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 515/988] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:07 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:30:09.173413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:09.173413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:09.173413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:09.173413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:09.174270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:09.174270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:09.292975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:09.301356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:09.307774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:09.307774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc890629-4334-43ed-9f1b-b376f669e6e8 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.158635 Jun 02 13:30:09.307774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 474/989] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:09 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:10.323792 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:10.324413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:10.331815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:10.332293 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:10.333074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:10.333516 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:10.474270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:10.483309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:10.484899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:10.486123 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-db5fe562-c9dc-43b9-abe5-b2628625c352 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.166338 Jun 02 13:30:10.486681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 516/990] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:10 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:11.504553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:11.505096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:11.511586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:11.512079 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:11.512834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:11.513259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:11.652489 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:11.660978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:11.662476 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:11.663637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cde8ef50-b524-4a62-b288-75f181a50832 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.163114 Jun 02 13:30:11.664231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 475/991] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:11 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:12.682271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:12.682866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:12.689892 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:12.690331 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:12.691079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:12.691511 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:12.825097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:12.833071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:12.834563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:12.835712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-950a4b34-7b58-43ff-88cd-6c246e31a716 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.157342 Jun 02 13:30:12.836574 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 517/992] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:12 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:13.853921 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:13.854539 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:13.861819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:13.862272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:13.863046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:13.863514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:13.994345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:14.002709 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:14.004221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:14.005364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9d22659a-817a-4dc7-a126-627311d7163a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.155403 Jun 02 13:30:14.005909 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 476/993] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:13 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:15.026222 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:15.026846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:15.034181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:15.034629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:15.035400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:15.035833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:15.176872 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:15.185292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:15.186895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:15.188085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a71d655c-e8db-4763-a0c4-69530fde4e21 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.167821 Jun 02 13:30:15.188639 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 518/994] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:15 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:16.205929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:16.206519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:16.213303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:16.213744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:16.214499 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:16.214926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:16.348752 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:16.356659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:16.358824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:16.360001 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4e340365-15f3-4008-923b-a8c92d59918a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.157939 Jun 02 13:30:16.360547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 477/995] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:16 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:17.380623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:17.381339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:17.390342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:17.391043 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:17.393062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:17.393744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:17.568235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:30:17.568803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:30:17.704979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:17.713554 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:17.715067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:17.716273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-13fdf3cf-fd2c-4e99-bbaf-b9cd63de4e2b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.340887 Jun 02 13:30:17.716953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 519/996] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:17 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:17.925341 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:17.925758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:17.932614 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:17.933066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:17.933833 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:17.934269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:17.960747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:30:18.251516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ee9637db-1949-445a-8f55-6c1437baecd5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 204 len: 0 microversion: 2.1 time: 0.329823 Jun 02 13:30:18.252083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 478/997] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:30:17 2022] DELETE /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:30:18.260441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:18.261097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:18.267449 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:18.267905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:18.268702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:18.269133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:18.411505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:18.420758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2658185c-b350-4a7f-a440-29c41e72edd6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1576 microversion: 2.1 time: 0.163540 Jun 02 13:30:18.421348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 520/998] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:18 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:18.735309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:18.736042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:18.743065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:18.743065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:18.743395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:18.744352 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:18.933432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:18.942067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:18.944514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:18.945967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-49caa7e8-58d4-463b-b16e-dd41bcbe270c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.214776 Jun 02 13:30:18.946683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 479/999] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:18 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:19.438824 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:19.439433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:19.446035 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:19.446480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:19.447246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:19.447678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:19.544487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-9a213681-8bcd-4312-8473-b454a5f8c21c req-c5619718-b206-4c9b-b138-0463fa8b454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "name": "network-vif-plugged", "status": "completed", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:19.553427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9a213681-8bcd-4312-8473-b454a5f8c21c req-c5619718-b206-4c9b-b138-0463fa8b454e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:19.553932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9a213681-8bcd-4312-8473-b454a5f8c21c req-c5619718-b206-4c9b-b138-0463fa8b454e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:19.566253 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-9a213681-8bcd-4312-8473-b454a5f8c21c req-c5619718-b206-4c9b-b138-0463fa8b454e service nova] Creating event network-vif-plugged:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:30:19.571297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-9a213681-8bcd-4312-8473-b454a5f8c21c req-c5619718-b206-4c9b-b138-0463fa8b454e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030344 Jun 02 13:30:19.571914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 480/1000] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:30:19.589037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:19.596839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-54a33c79-4239-4c4c-a1c6-26089d5c2d6f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1576 microversion: 2.1 time: 0.162436 Jun 02 13:30:19.597415 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 521/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:19 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:19.971413 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:19.972062 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:19.978426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:19.978870 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:19.979638 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:19.980129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:20.112391 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:20.120532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:20.122047 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:20.123239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3270262-637d-4ebd-b225-db76986cb79e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.157245 Jun 02 13:30:20.123799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 481/1002] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:19 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:20.614318 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:20.614924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:20.621928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:20.635348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:20.635348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:20.635348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:20.805162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:20.813205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1a78f7f6-d6e2-44a3-9bd8-b287df747328 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1576 microversion: 2.1 time: 0.202637 Jun 02 13:30:20.813978 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 522/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:20 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:21.141920 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:21.142547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:21.149311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:21.149753 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:21.150526 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:21.151550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:21.219162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-9faca035-449e-405e-93af-c48b4b4c5850 req-95082597-06ce-45d3-908c-2b728ad417e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a92ef8-3817-4bc0-9020-ec93a0c61dd6", "name": "network-vif-deleted", "tag": "590b0692-8b79-4eed-aa0b-99e7b95057de"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:21.228456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-9faca035-449e-405e-93af-c48b4b4c5850 req-95082597-06ce-45d3-908c-2b728ad417e7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:21.230566 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-9faca035-449e-405e-93af-c48b4b4c5850 req-95082597-06ce-45d3-908c-2b728ad417e7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:21.242280 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-9faca035-449e-405e-93af-c48b4b4c5850 req-95082597-06ce-45d3-908c-2b728ad417e7 service nova] Creating event network-vif-deleted:590b0692-8b79-4eed-aa0b-99e7b95057de for instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 on hv-cinder-79760 Jun 02 13:30:21.249148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-9faca035-449e-405e-93af-c48b4b4c5850 req-95082597-06ce-45d3-908c-2b728ad417e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Jun 02 13:30:21.249958 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 523/1004] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:30:21.317716 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:21.328592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:21.329284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:21.331358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f755c3ab-824e-4ebf-837d-f0c0a37f33b0 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1742 microversion: 2.20 time: 0.193878 Jun 02 13:30:21.332170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 482/1005] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:21 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:21.835642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:21.840618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:21.843181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:21.843628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:21.844447 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:21.844881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:21.910938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:21.918815 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-75373ce9-f0f3-4754-9a23-f348224a1471 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 200 len: 1224 microversion: 2.1 time: 0.087862 Jun 02 13:30:21.920867 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 524/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:21 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:22.359534 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:22.360881 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:22.370918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:22.375033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:22.375033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:22.375033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:22.542063 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:22.551439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:22.553104 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:22.554276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7cb7300d-c2cb-4d06-a1e6-7bf9d0ecf28a tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.206010 Jun 02 13:30:22.555299 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 483/1007] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:22 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:22.936829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:22.937340 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:22.943866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:22.944335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:22.945176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:22.945609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:22.960505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] HTTP exception thrown: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Request method failure captured: Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 HTTP/1.1 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLqK_ntzUvvFPKTi3GSbGPOwA3XvIY-ygSBuhDCwC3zULOoycC3y6zQmGLUGjyExbEBFvZR6C9F9nCsi5XDhxF4F2ewmSsgmW3txNsLQPsZ9AZva0bOm4iwQqwSrKtOk-zQRLyk-hw2IssMyiTbXYjHC6FrIMtzlSdfC1H6eVgyytYU Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:30:22.976553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05cc8cf8ca8a43a1bacdc454652cfde2"}]}] Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestVolumeBootPattern-578717993 Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 14bd9be0202b433cb1fa8be6afee8ee5 Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:30:22.978971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '68a92ef8-3817-4bc0-9020-ec93a0c61dd6'} Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:30:22.979967 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:30:22.981541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:30:22.982979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Returning 404 to user: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:30:22.982979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7e28fa3a-25e4-4811-9723-15bcc12b7116 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 404 len: 111 microversion: 2.1 time: 0.031406 Jun 02 13:30:22.982979 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 525/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:22 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:30:23.064947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1776627415", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160009625", "security_groups": [{"name": "tempest-secgroup-smoke-705320696"}], "block_device_mapping_v2": [{"uuid": "61b85096-f3a0-4a46-9380-3eee42639f8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "078003a7-efc0-4857-99dc-d1c589b32c88"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:23.206083 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] validate_networks() for [('078003a7-efc0-4857-99dc-d1c589b32c88', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:30:23.579655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:23.580276 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:23.587317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:23.588228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:23.589177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:23.589770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:23.671636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:30:23.672887 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:30:23.673519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:30:23.674065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:30:23.674643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:30:23.689837 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:23.690319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:23.691062 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:23.697384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:23.725767 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:30:23.730693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for user 14bd9be0202b433cb1fa8be6afee8ee5 and project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:30:23.778693 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:23.793062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:23.794572 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:23.798342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b22cc190-7240-4934-85d4-bd260da210d5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.224554 Jun 02 13:30:23.799458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 526/1009] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:23 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:30:23.812197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:30:23.814287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b85096-f3a0-4a46-9380-3eee42639f8d',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:30:24.334205 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aa6743ea-7123-48b3-bd96-ea9a089145c0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.273488 Jun 02 13:30:24.345223 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2bb82be8-3a04-4216-9fa2-78278717363f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:24.345936 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2bb82be8-3a04-4216-9fa2-78278717363f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:24.349900 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 484/1010] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:30:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:30:24.427362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2bb82be8-3a04-4216-9fa2-78278717363f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:24.437024 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2bb82be8-3a04-4216-9fa2-78278717363f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1094 microversion: 2.1 time: 0.094236 Jun 02 13:30:24.437960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 527/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:24 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:30:24.818545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:24.820186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:24.828975 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:24.829430 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:24.830213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:24.830650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:24.835253 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:25.001557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:25.012960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:25.012960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:25.015015 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-777c8d91-fc62-4265-ab8f-7fab81473724 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.199893 Jun 02 13:30:25.015937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 485/1012] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:24 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:30:25.455446 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:25.456541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:25.477725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:25.479744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:25.483192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:25.483755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:25.573125 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:25.586380 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0ea5fd1f-5c63-455a-9412-58dde667b2fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1144 microversion: 2.1 time: 0.134701 Jun 02 13:30:25.599492 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 528/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:25 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1144 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:26.034846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:26.035464 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:26.042516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:26.042965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:26.043729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:26.044197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:26.184829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:26.193308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:26.194935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:26.196148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b6b3cc60-c932-4645-86ab-f29e667ebd16 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.165590 Jun 02 13:30:26.196721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 486/1014] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:26 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:26.605029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:26.605634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:26.613629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:26.614108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:26.614905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:26.615341 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:26.684191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:26.691800 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8def0fca-7e18-404f-ac41-588278226fee tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1192 microversion: 2.1 time: 0.090769 Jun 02 13:30:26.692396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 529/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:26 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:27.221477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:27.223902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:27.231947 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:27.232660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:27.233649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:27.234300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:27.488898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:27.500733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:27.502450 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:27.503933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c0a62314-8050-4889-b181-7ad9fe35fe9e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.293196 Jun 02 13:30:27.515011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 487/1016] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:27 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:27.715348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:27.715913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:27.723020 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:27.723529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:27.724299 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:27.724923 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:27.791682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:27.805810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-100886ea-6490-42af-97df-d7dc6fc37185 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1210 microversion: 2.1 time: 0.094997 Jun 02 13:30:27.806634 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 530/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:27 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:28.542721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:28.545210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:28.597824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:28.599004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:28.599999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:28.600590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:28.827068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:28.828400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:28.844470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:28.845885 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:28.849425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:28.851613 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:28.865000 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:29.244640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:29.258823 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:29.263637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:29.265077 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bd4eba33-d931-48de-885d-e6b34c786d60 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.742341 Jun 02 13:30:29.265791 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 488/1018] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:28 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:29.389822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:29.398553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ceda5576-006d-424e-ab7b-3514b78a4f4f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1277 microversion: 2.1 time: 0.576140 Jun 02 13:30:29.409307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 531/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:28 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1277 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:30.103798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-e29a8295-f034-4c10-a182-0f72034f03b0 req-6a964851-a28d-4eda-b2ff-59d99d08260a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e26885-8b93-46a9-945a-596a3957445e", "tag": "bbdface1-3f0e-4266-9432-abdd2169f13c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:30.130095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e29a8295-f034-4c10-a182-0f72034f03b0 req-6a964851-a28d-4eda-b2ff-59d99d08260a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:30.131123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e29a8295-f034-4c10-a182-0f72034f03b0 req-6a964851-a28d-4eda-b2ff-59d99d08260a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:30.146363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-e29a8295-f034-4c10-a182-0f72034f03b0 req-6a964851-a28d-4eda-b2ff-59d99d08260a service nova] Creating event network-changed:bbdface1-3f0e-4266-9432-abdd2169f13c for instance e8e26885-8b93-46a9-945a-596a3957445e on hv-cinder-79760 Jun 02 13:30:30.151828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-e29a8295-f034-4c10-a182-0f72034f03b0 req-6a964851-a28d-4eda-b2ff-59d99d08260a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066542 Jun 02 13:30:30.152594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 489/1020] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:30.288789 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:30.291063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:30.304763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:30.305734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:30.306884 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:30.307563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:30.441005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:30.441005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:30.441005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:30.441005 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:30.442048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:30.442048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:30.591836 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:30.594961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:30.599661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-04eb23a4-30dd-4988-8b4e-8a522acee6dd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.186857 Jun 02 13:30:30.606388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:30.607188 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 490/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:30 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:30:30.609011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:30.610709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-59c42aa6-a2d6-4bd7-802b-826435bda619 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.330340 Jun 02 13:30:30.611409 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 532/1022] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:30 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:30.993170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:30.993727 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:31.001598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.001598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:31.002172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.002723 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:31.030225 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f74bf763-bf1b-413a-9920-4bd81fe3e8fd tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/ips" status: 200 len: 145 microversion: 2.1 time: 0.041043 Jun 02 13:30:31.031255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 491/1023] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:30:30 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:31.617089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:31.618630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:31.632906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.633668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:31.634819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.635478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:31.861329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:31.874565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-73a5457d-c464-4a6e-98d0-d454b3ae3a49 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.261447 Jun 02 13:30:31.877922 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 533/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:31 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:31.937168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:31.938650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:31.946691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.947245 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:31.948127 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:31.948989 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:32.120768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:32.132532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:32.134479 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:32.135760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bab041e2-82dc-4196-b438-3e8c77718aa3 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.510682 Jun 02 13:30:32.147756 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 492/1025] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:31 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:32.900033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:32.901942 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:32.913408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:32.914180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:32.915366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:32.915939 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:32.991578 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81eb64ed-c5c8-4861-945a-108a297289ff"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:32.993442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:33.010719 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:33.021192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:33.025329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:33.027460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:33.027460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:33.193010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:33.205410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eddf0df7-c764-429d-82da-7c7cec50f4fe tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.311292 Jun 02 13:30:33.206091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 534/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:32 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:33.223928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:33.224879 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:33.234086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:33.237982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:33.237982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:33.237982 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:33.433769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:33.464531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:33.467698 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:33.469030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a7ad038-4d46-48e0-bb03-c221885cfbbf tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.260333 Jun 02 13:30:33.469851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 535/1027] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:33 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:33.716331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:33.739992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:33.978535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e3b9dfae-c9ec-4ced-8a38-c533a04b255c tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.993237 Jun 02 13:30:33.979267 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 493/1028] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:30:32 2022] POST /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:34.226282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:34.227007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:34.241406 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:34.242238 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:34.243332 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:34.243985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:34.432302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:34.459061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:34.473121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fb76e7f7-39d4-4ad9-ab37-76d4979d259a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.253683 Jun 02 13:30:34.474241 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 536/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:34 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:34.488818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:34.490009 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:34.502432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:34.503139 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:34.504854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:34.505612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:34.650544 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:34.661571 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:34.717948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:34.717948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d791db68-86b1-45cd-be0c-aa6c0667f787 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.180649 Jun 02 13:30:34.717948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 494/1030] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:34 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:35.492183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:35.498680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:35.508207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:35.508930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:35.513695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:35.513695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:35.700614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:35.712459 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:35.713070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:35.727600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-97351d91-e3e4-4ac3-8584-be6273431982 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.240161 Jun 02 13:30:35.729804 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:35.730250 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:35.732750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:35.732750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:35.738843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 537/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:35 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:35.929943 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:35.941403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:35.946661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:35.946661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0f114684-9154-4743-b889-60d97c4eed89 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.236212 Jun 02 13:30:35.946661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 495/1032] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:35 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:36.758933 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:36.759549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:36.761972 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=55 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:36.767339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:36.767857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:36.768591 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:36.769033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:36.904819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:36.913136 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-938d53bc-9ed5-4904-93b5-dac7a99016fa tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.159774 Jun 02 13:30:36.913774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 538/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:36 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:36.963321 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:36.963953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:36.971273 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:36.971722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:36.972531 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:36.972970 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:37.107850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:37.118199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:37.119729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:37.120954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3e6067a0-8398-4124-929f-f9406475cc7e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1737 microversion: 2.20 time: 0.161940 Jun 02 13:30:37.121511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 496/1034] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:36 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:37.930192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:37.931143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:37.937684 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:37.938138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:37.938916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:37.939363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:38.072423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:38.080055 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bc0a0ab2-928d-443c-931c-eaadab76ffda tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.153764 Jun 02 13:30:38.080637 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 539/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:37 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:38.139616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:38.140260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:38.146817 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:38.147263 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:38.148053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:38.148491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:38.282284 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:38.291575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:38.293154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:38.296184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e1928f7a-9dac-4cfd-9caa-db2d09a0785c tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1719 microversion: 2.20 time: 0.160109 Jun 02 13:30:38.297357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 497/1036] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:38 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:39.097105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:39.097711 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:39.104207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:39.104645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:39.105475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:39.105925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:39.287649 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:39.295578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8fafe4f7-3cd8-4e68-aab7-e8dac56f3910 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.202319 Jun 02 13:30:39.296715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 540/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:39 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:39.319973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:39.319973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:39.325308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:39.325834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:39.326591 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:39.327074 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:39.462827 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:39.471952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:39.473469 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:39.474648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e3ec2c02-e52e-4572-81a9-7991aad12419 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1719 microversion: 2.20 time: 0.160221 Jun 02 13:30:39.475202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 498/1038] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:39 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:39.692866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-5b430b09-28bf-46dd-9df4-751dbd7b25e0 req-39a8899e-30bb-495f-9641-f1f1c40eff5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "name": "network-vif-unplugged", "status": "completed", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:39.703068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-5b430b09-28bf-46dd-9df4-751dbd7b25e0 req-39a8899e-30bb-495f-9641-f1f1c40eff5b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:39.703596 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-5b430b09-28bf-46dd-9df4-751dbd7b25e0 req-39a8899e-30bb-495f-9641-f1f1c40eff5b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:39.715570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-5b430b09-28bf-46dd-9df4-751dbd7b25e0 req-39a8899e-30bb-495f-9641-f1f1c40eff5b service nova] Creating event network-vif-unplugged:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:30:39.721471 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-5b430b09-28bf-46dd-9df4-751dbd7b25e0 req-39a8899e-30bb-495f-9641-f1f1c40eff5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033139 Jun 02 13:30:39.738659 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 541/1039] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:40.313399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:40.314017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:40.320249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:40.320883 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:40.321454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:40.322059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:40.468586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:40.476389 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8d95bbf2-64da-4e08-bcfc-e3c2ee295109 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.167050 Jun 02 13:30:40.476933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 499/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:40 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:40.494411 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:40.495112 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:40.501497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:40.501952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:40.502753 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:40.503189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:40.650938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:40.660530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:40.662026 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:40.663187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bff0103c-5c55-42f2-a1d3-a45d18a0acdb tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1719 microversion: 2.20 time: 0.173560 Jun 02 13:30:40.663752 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 542/1041] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:40 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:41.493779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:41.494385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:41.501652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.502094 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.502854 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.503288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.640029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:41.647585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-61a73a4f-9acf-42a4-b666-82b2b99bf799 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.157737 Jun 02 13:30:41.648129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 500/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:41 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:41.681552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:41.682170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:41.689497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.689974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.690746 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.691180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.826775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:41.832888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-62162dee-d8a6-4aff-a516-14aa7a7987e7 req-f9965eda-ba99-481e-9276-b3c7bfe42ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e26885-8b93-46a9-945a-596a3957445e", "name": "network-vif-plugged", "status": "completed", "tag": "bbdface1-3f0e-4266-9432-abdd2169f13c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:41.841932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:41.841932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:41.841932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dc2ed8c3-5506-4e31-877d-c88514c4465b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1722 microversion: 2.20 time: 0.162982 Jun 02 13:30:41.842279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 543/1043] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:41 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:41.843913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-62162dee-d8a6-4aff-a516-14aa7a7987e7 req-f9965eda-ba99-481e-9276-b3c7bfe42ecc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.843913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-62162dee-d8a6-4aff-a516-14aa7a7987e7 req-f9965eda-ba99-481e-9276-b3c7bfe42ecc service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.854743 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-62162dee-d8a6-4aff-a516-14aa7a7987e7 req-f9965eda-ba99-481e-9276-b3c7bfe42ecc service nova] Creating event network-vif-plugged:bbdface1-3f0e-4266-9432-abdd2169f13c for instance e8e26885-8b93-46a9-945a-596a3957445e on hv-cinder-79760 Jun 02 13:30:41.860400 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-62162dee-d8a6-4aff-a516-14aa7a7987e7 req-f9965eda-ba99-481e-9276-b3c7bfe42ecc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Jun 02 13:30:41.860987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3126d96-6386-4ef9-b120-4bca7bad01ce"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:41.861173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 501/1044] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:30:41.862189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:41.868692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.870481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:41.870481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:41.870481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:42.665828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:42.666533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:42.673024 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:42.673476 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:42.674244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:42.674685 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:42.678826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:42.814272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:42.822265 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1dc04750-de3d-4b83-8a7e-d0c6e8a228f0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.161343 Jun 02 13:30:42.824824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 502/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:42 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:43.214614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4a00d172-9a17-4e19-8ffe-cbc63df5fd39 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.359126 Jun 02 13:30:43.215239 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 544/1046] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Jun 2 13:30:41 2022] POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments => generated 188 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:30:43.347361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:43.348694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:43.355866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.355866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.355866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.355866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.635442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:43.636453 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:43.645866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.646314 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.647089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.647524 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.673439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:43.678322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9ef4dff7-4ff1-45d1-8f35-269c1b4fb3eb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Jun 02 13:30:43.678984 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 545/1047] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:30:43 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:43.688935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:43.689432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:43.696455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.696907 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.697681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.698298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.731714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fdc11cb4-e0a4-4f62-89d9-88f452a6e7ab tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff" status: 200 len: 194 microversion: 2.1 time: 0.046637 Jun 02 13:30:43.734292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 546/1048] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 2 13:30:43 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:30:43.839724 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:43.840579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:43.851632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.854229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.855130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:43.855579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:43.999470 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:44.009191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ad0c9966-61a9-459a-8c59-666f37b9b0a8 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1265 microversion: 2.1 time: 0.172747 Jun 02 13:30:44.009777 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 547/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:43 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:30:44.044292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f1ed434f-f19a-4aa5-b1c7-f471ee0dfca5 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments/a3126d96-6386-4ef9-b120-4bca7bad01ce" status: 202 len: 0 microversion: 2.20 time: 0.701931 Jun 02 13:30:44.044870 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 503/1050] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Jun 2 13:30:43 2022] DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments/a3126d96-6386-4ef9-b120-4bca7bad01ce => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:30:44.109011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:44.109601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:44.116500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:44.142687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:44.142687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:44.142687 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:44.489046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-07ed79ad-c867-421e-bce9-d27f6c21171f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/action" status: 202 len: 0 microversion: 2.20 time: 0.383944 Jun 02 13:30:44.490733 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 548/1051] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 2 13:30:44 2022] POST /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:30:44.499778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:44.500514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:44.507950 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:44.508527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:44.509397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:44.510016 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:44.665180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:44.682611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:44.684788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:44.687406 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d2d7e50f-0016-4b2a-a1e4-6779fe1d06ed tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1670 microversion: 2.20 time: 0.191393 Jun 02 13:30:44.692219 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 504/1052] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:44 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:45.028194 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:45.029365 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:45.036592 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.036950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.039626 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.040288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.197301 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:45.209688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a727def-8cf9-410b-9b61-b5dca38a6624 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1452 microversion: 2.1 time: 0.186913 Jun 02 13:30:45.210272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 549/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:45 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:45.226774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:45.227409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:45.234384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.234839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.235948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.236082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.393110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:45.403140 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a2f80626-09f7-4bf3-b45a-a6241e306368 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1452 microversion: 2.1 time: 0.180163 Jun 02 13:30:45.403764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 505/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:30:45 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:30:45.707665 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:45.708965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:45.717514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.720500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.720500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:45.720500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:45.948812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:45.961666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:45.963363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:45.964776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6d05e2a9-8ce5-44ca-bc46-bac5a0284e81 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1670 microversion: 2.20 time: 0.261968 Jun 02 13:30:45.976557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 550/1055] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:45 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:46.566460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a3709f0-a4b7-43d3-a05e-45df1fcd336b"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:46.568961 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:46.576954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:46.577739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:46.579012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:46.579994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:46.989876 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:46.990492 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:47.006014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:47.006014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:47.006014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:47.006014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:47.265680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:47.275053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:47.277344 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:47.278778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-421c5aec-8183-48eb-9c8e-2b3ba061debc tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.299640 Jun 02 13:30:47.280848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 551/1056] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:46 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:30:47.540911 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-545dfb9b-5d06-4e59-b51a-a8b2cd7aa3f8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "POST /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978579 Jun 02 13:30:47.541874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 506/1057] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:30:46 2022] POST /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:48.049717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-9165e2a8-e423-4254-aca7-cf73df39afbe req-f4f65ac9-4450-4ab7-9984-6689108d8bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e26885-8b93-46a9-945a-596a3957445e", "tag": "bbdface1-3f0e-4266-9432-abdd2169f13c"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:30:48.062819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-9165e2a8-e423-4254-aca7-cf73df39afbe req-f4f65ac9-4450-4ab7-9984-6689108d8bc7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:48.062819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-9165e2a8-e423-4254-aca7-cf73df39afbe req-f4f65ac9-4450-4ab7-9984-6689108d8bc7 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:48.077219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-9165e2a8-e423-4254-aca7-cf73df39afbe req-f4f65ac9-4450-4ab7-9984-6689108d8bc7 service nova] Creating event network-changed:bbdface1-3f0e-4266-9432-abdd2169f13c for instance e8e26885-8b93-46a9-945a-596a3957445e on hv-cinder-79760 Jun 02 13:30:48.083158 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-9165e2a8-e423-4254-aca7-cf73df39afbe req-f4f65ac9-4450-4ab7-9984-6689108d8bc7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037447 Jun 02 13:30:48.084503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 552/1058] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:48.302325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:48.303002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:48.314995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:48.315295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:48.316289 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:48.326008 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:48.619613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:48.633759 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:48.635601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:48.636849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1e23d378-3f61-4bff-8da3-91c535a20646 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.340158 Jun 02 13:30:48.642117 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 507/1059] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:48 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:49.671246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:49.672571 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:49.680148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:49.681009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:49.681953 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:49.682553 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:49.869938 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:49.880842 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:49.882420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:49.884787 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b84049f9-d3ba-47a9-a061-f8625e124c7f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.226263 Jun 02 13:30:49.898083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 553/1060] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:49 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:50.911841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:50.914747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:50.922282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:50.922729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:50.925145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:50.925145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:51.109729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:51.118739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:51.120310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:51.121535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a521aa16-7212-4292-b9b6-ca39ad1cb033 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.221806 Jun 02 13:30:51.133869 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 508/1061] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:50 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:52.140264 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:52.141111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:52.148290 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:52.149022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:52.150071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:52.152295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:52.386674 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:52.401642 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:52.405727 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:52.407645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0f24bbb9-25dc-4812-892d-5796ad88db26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.271604 Jun 02 13:30:52.409157 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 554/1062] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:52 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:53.427042 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.428427 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:53.447550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:53.452834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:53.452834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:53.452834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:53.711287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:53.731365 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:53.733553 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:53.734841 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-30df8926-670d-4365-a6bd-ccfce51d2e26 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.312079 Jun 02 13:30:53.735374 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 509/1063] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:54.754149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:54.755647 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:54.763138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:54.763812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:54.764712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:54.765224 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:54.916838 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:54.927453 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:54.930089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:54.932486 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e45255c9-6330-46c1-93b3-41f97e22e55f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.182329 Jun 02 13:30:54.945253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 555/1064] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:54 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:55.958808 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:55.965657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:55.968209 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:55.968209 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:55.968871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:55.969313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:56.111865 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:56.120775 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:56.123137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:56.125435 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2d31072d-f827-43cd-93bd-430690d57a48 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.169604 Jun 02 13:30:56.128750 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 510/1065] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:55 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:57.143935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:57.144529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:57.151033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:57.151477 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:57.152274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:57.152705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:57.283525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:57.291515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:57.293612 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:57.294228 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-675e3557-bd6d-40ad-b2de-0595c4fe0296 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.154270 Jun 02 13:30:57.294788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 556/1066] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:57 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:58.312953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:58.317213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:58.320106 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:58.320551 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:58.321299 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:58.321728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:58.458965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:58.467276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:58.468901 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:58.471774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0757a74b-cb6a-4f35-8fc4-d1450bf0262e tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.161616 Jun 02 13:30:58.471774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 511/1067] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:58 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:59.488265 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:59.488868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:30:59.495274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:59.495717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:59.496514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:30:59.496971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:30:59.623399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:59.631288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:59.632818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:30:59.633973 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d5c21809-8e63-4713-bef4-52f90ab889c1 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.149694 Jun 02 13:30:59.634534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 557/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:30:59 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:00.652110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:00.652722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:00.659624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:00.660102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:00.660942 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:00.661334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:00.788169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:00.797222 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:00.798734 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:00.799996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bf96d725-8006-4773-b118-0e6323bba313 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.151782 Jun 02 13:31:00.800567 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 512/1069] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:00 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:01.819529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:01.820103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:01.827238 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:01.827680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:01.828457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:01.828891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:01.967688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:01.975781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:01.977318 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:01.978474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cece70f2-7cde-4838-b980-5dcd09ebc98b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.163037 Jun 02 13:31:01.979044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 558/1070] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:01 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:02.996511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:02.997745 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:03.004357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:03.004800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:03.005560 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:03.005994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:03.389875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:03.398259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:03.399754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:03.400959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-29a4c410-776f-47db-af6d-66c2fa9a4983 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.408406 Jun 02 13:31:03.401519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 513/1071] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:02 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:04.419199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:04.419807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:04.426442 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.426891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.427653 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.428124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.563181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:04.571281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:04.572961 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:04.574178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-855ef373-e3f4-4989-a4c6-aa404914bf9f tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.158931 Jun 02 13:31:04.574660 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 559/1072] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:04 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:04.681163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:04.682136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:04.685171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=42 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:04.689954 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.690403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.691162 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.691589 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.722037 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1b013efd-94fb-4a92-91d0-ebbc12af86b2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044739 Jun 02 13:31:04.722602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 514/1073] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:31:04 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:04.882428 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:04.882919 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:04.889053 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.889498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.890262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.890695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.920966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c5aff74-6097-4c8b-98a0-5122da6066bb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff" status: 200 len: 194 microversion: 2.1 time: 0.042490 Jun 02 13:31:04.921569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 560/1074] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 2 13:31:04 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:04.931144 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:04.931667 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:04.937788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.938245 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.939009 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:04.939442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:04.941993 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:05.024676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lazy-loading 'services' on Instance uuid cd57b3c0-c014-4315-8151-9b71ea242990 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:31:05.271414 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cf41a062-da88-4215-b9ee-fdaf14276880 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff" status: 202 len: 0 microversion: 2.1 time: 0.344004 Jun 02 13:31:05.272044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 515/1075] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:31:04 2022] DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/81eb64ed-c5c8-4861-945a-108a297289ff => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:31:05.592929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:05.593573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:05.600246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:05.600697 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:05.601472 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:05.601912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:05.734506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:05.742952 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:05.744624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:05.745886 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-879075a1-56be-4870-9cd5-1131bf741a68 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.157523 Jun 02 13:31:05.746855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 561/1076] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:05 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:05.861999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-a72529ce-e925-4afd-a56c-aacde72b8cb9 req-f2ed07e0-d91b-4f75-ac5f-f81aa5dfc0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "name": "network-vif-plugged", "status": "completed", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:05.871189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a72529ce-e925-4afd-a56c-aacde72b8cb9 req-f2ed07e0-d91b-4f75-ac5f-f81aa5dfc0c8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:05.871632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a72529ce-e925-4afd-a56c-aacde72b8cb9 req-f2ed07e0-d91b-4f75-ac5f-f81aa5dfc0c8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:05.885075 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-a72529ce-e925-4afd-a56c-aacde72b8cb9 req-f2ed07e0-d91b-4f75-ac5f-f81aa5dfc0c8 service nova] Creating event network-vif-plugged:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:31:05.890222 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-a72529ce-e925-4afd-a56c-aacde72b8cb9 req-f2ed07e0-d91b-4f75-ac5f-f81aa5dfc0c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033544 Jun 02 13:31:05.890828 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 516/1077] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:06.763148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:06.763758 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:06.771072 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:06.771462 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:06.772306 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:06.772745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:06.777104 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:06.911321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:06.920461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:06.922017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:06.923207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-881f6289-eb8d-445c-b5e7-4de783a16397 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.164047 Jun 02 13:31:06.923775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 562/1078] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:06 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:07.438143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:07.438726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:07.445602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.446052 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:07.446812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.447249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:07.476201 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9cd5613d-c71d-479e-881e-42d078128a05 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/2a3709f0-a4b7-43d3-a05e-45df1fcd336b" status: 200 len: 194 microversion: 2.1 time: 0.042326 Jun 02 13:31:07.476849 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 517/1079] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 2 13:31:07 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/2a3709f0-a4b7-43d3-a05e-45df1fcd336b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:07.486669 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:07.487165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:07.489098 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=52 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:07.493863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.494257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:07.495019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.495489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:07.573724 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lazy-loading 'services' on Instance uuid cd57b3c0-c014-4315-8151-9b71ea242990 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:31:07.775206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-884a465c-a376-4664-8592-e55a79a2651f tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/2a3709f0-a4b7-43d3-a05e-45df1fcd336b" status: 202 len: 0 microversion: 2.1 time: 0.292213 Jun 02 13:31:07.775854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 563/1080] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:31:07 2022] DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments/2a3709f0-a4b7-43d3-a05e-45df1fcd336b => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:31:07.942303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:07.948357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:07.949011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.949463 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:07.950846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:07.951290 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:08.084491 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:08.093048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:08.094543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:08.095692 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-37e1bcc8-c192-4082-a37a-aa4d966e8270 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.158123 Jun 02 13:31:08.096294 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 518/1081] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:07 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:09.115049 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:09.115744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:09.122911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:09.123385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:09.124199 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:09.124645 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:09.266339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:09.275285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:09.275751 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:09.276930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2364c3a-121f-4169-aed1-f0ad8eee2964 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1728 microversion: 2.20 time: 0.166934 Jun 02 13:31:09.277484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 564/1082] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:09 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:31:09.989268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:09.990254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:09.997546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.000519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.000519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.000519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.029884 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b0baec7f-128b-47b6-a669-9fae6a72bd09 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044946 Jun 02 13:31:10.030461 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 519/1083] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:31:09 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:31:10.137763 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:10.138750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:10.145362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.145755 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.146521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.146959 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.176985 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff52c378-f455-48c1-a55b-968b3307b791 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043078 Jun 02 13:31:10.177546 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 565/1084] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:31:10 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:31:10.234210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:10.234707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:10.240686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.241146 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.241872 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.242299 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.267847 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:31:10.296304 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:10.296911 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:10.303658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.304202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.304860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.305328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.435338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:10.443321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:10.445429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:10.446324 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-20d00377-a59c-4fd9-a257-b2e26e01c66b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1715 microversion: 2.20 time: 0.154493 Jun 02 13:31:10.446881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 566/1085] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:31:10 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:31:10.684523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e26cb03a-708c-45b0-8187-64101433b1a5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 204 len: 0 microversion: 2.1 time: 0.454448 Jun 02 13:31:10.685032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 520/1086] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:31:10 2022] DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:10.693008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:10.693671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:10.699618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.700854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:10.701619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:10.702050 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:11.091797 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:11.099787 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d0c79863-3d84-402f-b51e-7c70b82781a2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1673 microversion: 2.1 time: 0.410548 Jun 02 13:31:11.100544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 567/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:10 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1673 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:11.886519 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:11.887190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:11.893839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:11.895116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:11.895116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:11.895453 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:11.918059 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lazy-loading 'flavor' on Instance uuid 9a2546d8-4a45-4698-8a8c-b3433197ebfb {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:31:12.118088 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:12.118794 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:12.125463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:12.125988 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:12.126787 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:12.127219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:12.253345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:12.260845 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b69ea9cc-9637-4bf0-87c9-09988e64a803 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1673 microversion: 2.1 time: 0.146994 Jun 02 13:31:12.261413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 568/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:12 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:12.356864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-488ab7f3-1e61-4614-8e13-8143a48604b2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "POST /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb/action" status: 202 len: 0 microversion: 2.1 time: 0.474349 Jun 02 13:31:12.357444 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 521/1089] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:31:11 2022] POST /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:31:12.366928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:12.367803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:12.374624 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:12.375076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:12.375850 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:12.376309 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:12.516283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:12.523682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-56f13647-21b5-496a-af50-c871bc0bb1a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.160600 Jun 02 13:31:12.524345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 569/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:12 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:13.279902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:13.283011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:13.287017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:13.287572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:13.288366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:13.288806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:13.540686 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:13.541208 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:13.542114 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:13.549326 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:13.549878 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:13.550011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8fae9429-d2ed-4059-82a6-70eef7a72aa5 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1673 microversion: 2.1 time: 0.274836 Jun 02 13:31:13.550679 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 522/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:13 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:13.550857 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:13.551477 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:13.699352 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:13.708668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ee57b43-d1f8-4c17-be88-e534e1dc3967 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.171778 Jun 02 13:31:13.709710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 570/1092] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:13 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:13.745424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-bf193249-4f1e-4411-9c99-2f755e07b611 req-0862d7d8-e099-495e-af7c-f677fc4dc87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd57b3c0-c014-4315-8151-9b71ea242990", "name": "network-vif-deleted", "tag": "c34e0ea9-afe9-4b4c-aa06-12b5c42fabff"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:13.754905 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bf193249-4f1e-4411-9c99-2f755e07b611 req-0862d7d8-e099-495e-af7c-f677fc4dc87c service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:13.761053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bf193249-4f1e-4411-9c99-2f755e07b611 req-0862d7d8-e099-495e-af7c-f677fc4dc87c service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:13.771530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-bf193249-4f1e-4411-9c99-2f755e07b611 req-0862d7d8-e099-495e-af7c-f677fc4dc87c service nova] Creating event network-vif-deleted:c34e0ea9-afe9-4b4c-aa06-12b5c42fabff for instance cd57b3c0-c014-4315-8151-9b71ea242990 on hv-cinder-79760 Jun 02 13:31:13.777875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-bf193249-4f1e-4411-9c99-2f755e07b611 req-0862d7d8-e099-495e-af7c-f677fc4dc87c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036110 Jun 02 13:31:13.779789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 523/1093] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:14.571448 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:14.572101 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:14.586417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:14.587012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:14.588178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:14.588902 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:14.627841 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:14.628327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:14.628965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lazy-loading 'fault' on Instance uuid cd57b3c0-c014-4315-8151-9b71ea242990 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:31:14.675937 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99a2ba62f3948e99f6e78cabade3685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c2f17d46e4ebd974386bc7fae2fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:14.683728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-711dd67f-1e34-4618-939a-24c15d74d691 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 200 len: 1327 microversion: 2.1 time: 0.116549 Jun 02 13:31:14.684897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 571/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:14 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:14.728133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:14.728133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:14.736478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:14.736946 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:14.737710 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:14.738520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:14.880154 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:14.890707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-70b8d053-2dd1-4717-9842-f56e69fcf39e tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.165903 Jun 02 13:31:14.890707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 524/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:14 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:15.702028 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:15.702585 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:15.709912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:15.710616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:15.711439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:15.711900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:15.725460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 HTTP/1.1 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:31:15.727208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:15.728652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'cd57b3c0-c014-4315-8151-9b71ea242990'} Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:31:15.730232 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:15.732688 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:15.733992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:31:15.733992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1608c9a5-9d27-40ea-8360-c0b4a835b278 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 404 len: 111 microversion: 2.1 time: 0.030958 Jun 02 13:31:15.733992 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 572/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:15 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:15.738471 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a8b2b32e-f8d6-4043-bba7-f1b9afd683fb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '.version_select at 0x7f5a8078ddc0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:15.742011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a8b2b32e-f8d6-4043-bba7-f1b9afd683fb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 13:31:15.905744 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:15.906344 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:15.912662 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:15.913103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:15.913865 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:15.914295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:16.045747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:16.053365 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fe92e3da-898c-4a65-bd74-b616c6bed00d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.151473 Jun 02 13:31:16.053928 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 573/1097] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:15 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:16.750053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [None req-a8b2b32e-f8d6-4043-bba7-f1b9afd683fb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [96e8d41a-5d77-4e96-b209-e48d0ee8ae6b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 38966. Jun 02 13:31:16.863099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a8b2b32e-f8d6-4043-bba7-f1b9afd683fb tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411426798" status: 202 len: 0 microversion: 2.1 time: 1.128490 Jun 02 13:31:16.863683 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 525/1098] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 2 13:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411426798 => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:31:17.071115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:17.071552 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:17.078388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:17.078829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:17.080029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:17.080631 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:17.356197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:17.364561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3e15bcc5-26c7-4f27-adc4-8f4ceb799ddb tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.297343 Jun 02 13:31:17.365458 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 574/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:17 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:18.383269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:18.384234 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:18.392197 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:18.392653 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:18.393648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:18.394091 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:18.535470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:18.543543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6f7d669a-7e04-41a8-be31-4c24a70a0ff7 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.165173 Jun 02 13:31:18.544150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 526/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:18 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:19.560124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:19.560734 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:19.567703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:19.568298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:19.569015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:19.569474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:19.706287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:19.714940 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9d6bcc58-c42a-4ec8-85bb-528ced983faf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.159177 Jun 02 13:31:19.715530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 575/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:19 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:20.258507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:20.259019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:20.266160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.266605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.267353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.267781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.282136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 HTTP/1.1 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:31:20.283813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.285404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'cd57b3c0-c014-4315-8151-9b71ea242990'} Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:31:20.286281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.287834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.289390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:31:20.289390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-45480305-b315-4e9b-bc64-198334908fb2 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 404 len: 111 microversion: 2.1 time: 0.030623 Jun 02 13:31:20.289390 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 527/1102] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:31:20 2022] DELETE /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:20.293918 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:20.294522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: cd57b3c0-c014-4315-8151-9b71ea242990] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:20.300599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.301040 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.301849 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.302226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.316784 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 HTTP/1.1 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:31:20.321132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.322605 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'cd57b3c0-c014-4315-8151-9b71ea242990'} Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:31:20.323533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. Jun 02 13:31:20.325254 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:20.326339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance cd57b3c0-c014-4315-8151-9b71ea242990 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:31:20.326339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f41ae866-5133-4f6b-84b7-05d82d87e0d8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990" status: 404 len: 111 microversion: 2.1 time: 0.029688 Jun 02 13:31:20.326339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 576/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:20 2022] GET /compute/v2.1/servers/cd57b3c0-c014-4315-8151-9b71ea242990 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:20.736511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:20.737133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:20.743335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.743790 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.744611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:20.745048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:20.882424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:20.891014 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c982c180-c51b-4892-b678-05ac9db3db89 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.158481 Jun 02 13:31:20.891625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 528/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:20 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:21.582611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:21.583144 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:21.590161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.591153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:21.591935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.592366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:21.606820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae HTTP/1.1 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:31:21.608416 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.609966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '1e59264d-5544-48cd-a508-5c7b119cfeae'} Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:31:21.610948 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.612493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.614192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:31:21.614192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f9da496d-52a1-4334-a79d-2cc2f42e3d6a tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 404 len: 111 microversion: 2.1 time: 0.031113 Jun 02 13:31:21.614192 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 577/1105] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:31:21 2022] DELETE /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:21.618319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:21.618930 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] [instance: 1e59264d-5544-48cd-a508-5c7b119cfeae] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:21.625596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.626040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:21.626800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.627229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:21.640919 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] HTTP exception thrown: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Request method failure captured: Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae HTTP/1.1 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkcfyAONk63gVnzGTpjM3BAzC9Uc79co6JTK0i-VUbHHpl3sN3Ul-5HRL6Yfz9Y6deZc_G3AGDxccJT12350RU3BKFj5-KP9Lgb9eA-F2zOx7mKXXm82mvSCliEMK8DR_ZDcLLD5F3wVq7uLmlfFZv7Ni_zQsu-40XTbrDoJoGwQYE Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:31:21.642514 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/907c2f17d46e4ebd974386bc7fae2fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_907c2f17d46e4ebd974386bc7fae2fc9"}]}] Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 907c2f17d46e4ebd974386bc7fae2fc9 Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607594559 Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a99a2ba62f3948e99f6e78cabade3685 Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeTestJSON-607594559-project Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.644107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '1e59264d-5544-48cd-a508-5c7b119cfeae'} Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:31:21.645040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. Jun 02 13:31:21.646466 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:31:21.647811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] Returning 404 to user: Instance 1e59264d-5544-48cd-a508-5c7b119cfeae could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:31:21.647811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-db0d68e6-4ad0-4909-a992-18bd8f9cd2b8 tempest-AttachVolumeTestJSON-607594559 tempest-AttachVolumeTestJSON-607594559-project] 10.222.0.46 "GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae" status: 404 len: 111 microversion: 2.1 time: 0.029434 Jun 02 13:31:21.647811 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 529/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:21 2022] GET /compute/v2.1/servers/1e59264d-5544-48cd-a508-5c7b119cfeae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:21.909251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:21.909771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:21.916672 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.917117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:21.917877 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:21.918323 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:22.144671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:22.152859 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7b4317a5-4d52-410c-9135-863cead43a7f tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.247328 Jun 02 13:31:22.154438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 578/1107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:21 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:23.170348 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:23.171032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:23.177941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:23.178195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:23.179096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:23.179789 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:23.399768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:23.421558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c7880b92-a454-4232-be25-cfb524d67728 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.255256 Jun 02 13:31:23.423916 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 530/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:23 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:24.439303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:24.439960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:24.446768 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:24.447217 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:24.448016 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:24.448473 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:24.655619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:24.659506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:24.664577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-738a3053-ead9-45d3-8526-6f317ffe75a3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.229347 Jun 02 13:31:24.675066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 579/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:24 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:25.682279 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:25.682890 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:25.696546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:25.696984 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:25.697757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:25.698184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:25.701898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.842741 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:25.850710 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-13e5cd7d-22ef-4a88-af15-f430258cb4ae tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.172389 Jun 02 13:31:25.851279 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 531/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:25 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:26.868124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:26.868729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:26.876348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:26.876820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:26.877631 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:26.878060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:27.021573 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:27.029257 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-09e1706c-4344-40a0-b076-f0e5a2132c74 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1509 microversion: 2.1 time: 0.165529 Jun 02 13:31:27.029833 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 580/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:26 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:27.046707 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:27.047322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:27.055243 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:27.055693 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:27.056511 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:27.056956 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:27.285180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-353c15c1-bd9d-4825-af0f-7721db31bb09 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "POST /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb/action" status: 202 len: 0 microversion: 2.1 time: 0.243131 Jun 02 13:31:27.285797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 532/1112] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 2 13:31:27 2022] POST /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:31:27.294547 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:27.295153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:27.301329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:27.301786 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:27.302545 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:27.302974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:27.460295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:27.470381 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1ec77b7a-adbd-42b7-a294-495470800d07 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1517 microversion: 2.1 time: 0.180124 Jun 02 13:31:27.471821 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 581/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:27 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:28.143124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-923ff6cf-e7fd-4418-8be6-8a723992f7d5 req-ca8c0bcc-3a58-4191-916e-fd7e0b6d617d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "name": "network-vif-unplugged", "status": "completed", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:28.151345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-923ff6cf-e7fd-4418-8be6-8a723992f7d5 req-ca8c0bcc-3a58-4191-916e-fd7e0b6d617d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:28.151792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-923ff6cf-e7fd-4418-8be6-8a723992f7d5 req-ca8c0bcc-3a58-4191-916e-fd7e0b6d617d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:28.166774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.compute.server_external_events [req-923ff6cf-e7fd-4418-8be6-8a723992f7d5 req-ca8c0bcc-3a58-4191-916e-fd7e0b6d617d service nova] Unable to find a host for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb. Dropping event network-vif-unplugged {{(pid=118131) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 02 13:31:28.166774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-923ff6cf-e7fd-4418-8be6-8a723992f7d5 req-ca8c0bcc-3a58-4191-916e-fd7e0b6d617d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.234680 Jun 02 13:31:28.166774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 533/1114] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 236 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 02 13:31:28.488182 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:28.488901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:28.495529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:28.496017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:28.496800 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:28.497310 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:28.634037 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:28.642274 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0802ca7d-bcfd-4c0e-a02e-3dee07de5c91 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1517 microversion: 2.1 time: 0.158028 Jun 02 13:31:28.643089 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 582/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:28 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:29.659965 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:29.660632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:29.667309 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:29.667768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:29.669172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:29.669604 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:29.809533 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:29.816882 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11184866-80cc-43dd-881b-b2076d7a37c3 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1519 microversion: 2.1 time: 0.160916 Jun 02 13:31:29.817539 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 534/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:29 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:30.834279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:30.835148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:30.841863 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:30.842307 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:30.843074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:30.843510 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:30.976666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:30.984695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-14ceed76-efce-4ecb-b156-89eb933ae8a5 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.154295 Jun 02 13:31:30.985270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 583/1117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:30 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:32.001715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:32.002334 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:32.009280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:32.009731 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:32.010507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:32.010944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:32.154601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:32.162754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3dea31c3-0947-4eb6-99d3-a6cf2d977876 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.164835 Jun 02 13:31:32.163343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 535/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:31 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:33.182812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:33.182812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:33.188060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:33.188507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:33.189280 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:33.189712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:33.334825 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:33.347208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34da6f2e-63a9-4acb-907d-2ecde83bdda2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.170393 Jun 02 13:31:33.348135 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 584/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:33 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:34.365322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:34.373703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:34.373703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:34.373703 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:34.374347 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:34.374822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:34.516623 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:34.524170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e17c2ba2-95cc-4ede-a221-de1b27ca8c90 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.163114 Jun 02 13:31:34.540289 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 536/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:34 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:35.555431 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:35.556061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:35.563388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:35.563836 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:35.564632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:35.565065 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:35.701455 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:35.709328 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff0631cc-adc8-43b4-bdcb-71547fdfbca9 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.157744 Jun 02 13:31:35.710149 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 585/1121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:35 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:36.726547 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:36.727159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:36.729494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.734329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:36.734776 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:36.735527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:36.736058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:36.867616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:36.875671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-06d653f2-db70-4564-b13d-35308db8be59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.152819 Jun 02 13:31:36.876283 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 537/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:36 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:37.892256 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:37.892843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:37.895200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=48 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.899930 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:37.900379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:37.901143 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:37.901575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:38.370609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:38.379003 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ce90aa27-c968-4dd9-8630-e198f61fe3ea tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.490506 Jun 02 13:31:38.383976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 586/1123] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:37 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:39.396401 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:39.397107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:39.404110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:39.404559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:39.405322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:39.405758 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:39.543224 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:39.551151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7c2ab0e8-d6e6-4b33-a22d-fe71a0ce8bf2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.159135 Jun 02 13:31:39.551732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 538/1124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:39 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:40.568950 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:40.569517 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:40.576351 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:40.576799 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:40.577767 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:40.578368 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:40.718376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:40.726125 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4df47d05-7a78-4376-86f4-ab8b3d85a981 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.161025 Jun 02 13:31:40.726682 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 587/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:40 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:41.744877 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:41.745486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:41.752322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:41.752765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:41.753520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:41.753948 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:41.890298 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:41.897987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eff5c567-1b17-4909-b060-2463f2227a5a tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.157031 Jun 02 13:31:41.898644 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 539/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:41 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:42.039525 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7708650b-ac9d-47e1-aa5f-e9acb5ba515b req-6bec4dbb-d0a0-4687-800b-dd3b8cd8f50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "name": "network-vif-plugged", "status": "completed", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:31:42.048737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7708650b-ac9d-47e1-aa5f-e9acb5ba515b req-6bec4dbb-d0a0-4687-800b-dd3b8cd8f50d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:42.059753 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7708650b-ac9d-47e1-aa5f-e9acb5ba515b req-6bec4dbb-d0a0-4687-800b-dd3b8cd8f50d service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:42.060492 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7708650b-ac9d-47e1-aa5f-e9acb5ba515b req-6bec4dbb-d0a0-4687-800b-dd3b8cd8f50d service nova] Creating event network-vif-plugged:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:31:42.065482 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7708650b-ac9d-47e1-aa5f-e9acb5ba515b req-6bec4dbb-d0a0-4687-800b-dd3b8cd8f50d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029655 Jun 02 13:31:42.066056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 588/1127] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:31:42.915090 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:42.915736 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:42.922725 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:42.923174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:42.923959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:42.924403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:43.055058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:43.063226 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6461149a-02be-456e-8799-db748e712a06 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.152292 Jun 02 13:31:43.063798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 540/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:42 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:44.081783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:44.082407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:44.088960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:44.090350 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:44.090648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:44.091083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:44.222180 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:44.230801 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1a993ee6-56f6-4e4d-9991-44e0528fe222 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1575 microversion: 2.1 time: 0.153231 Jun 02 13:31:44.231348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 589/1129] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:44 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:45.247597 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:31:45.248240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:31:45.254722 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:45.255168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:45.255945 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:31:45.256384 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:31:45.387202 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:31:45.395066 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5e997f3a-9529-423e-a817-e767c2270079 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1562 microversion: 2.1 time: 0.151318 Jun 02 13:31:45.395678 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 541/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:31:45 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:11.364925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:32:11.365532 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:32:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:32:14.726461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:14.727378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:14.729616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=7 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.730262 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=56 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.735423 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:14.735866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:14.736654 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:14.737080 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:14.770355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8c8a239f-c1d9-40bf-9146-feb3e1caa329 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047699 Jun 02 13:32:14.771061 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 590/1131] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 2 13:32:14 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:14.830878 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:14.831447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:14.833721 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=9 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.834620 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.840023 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:14.840470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:14.841230 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:14.841659 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:14.867277 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:32:15.151686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1ce598f9-35bf-48e8-b31f-58f8b90c9b10 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 204 len: 0 microversion: 2.20 time: 0.324340 Jun 02 13:32:15.152318 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 542/1132] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 2 13:32:14 2022] DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:32:15.161105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:15.161710 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:15.169683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:15.170128 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:15.170900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:15.171338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:15.313189 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:15.327507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:15.330539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:15.332680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3f0cb3bf-3265-46cd-8d50-b6d38d71d478 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.175734 Jun 02 13:32:15.333631 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 591/1133] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:15 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:32:16.352771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:16.356475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:16.360777 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:16.361227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:16.361994 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:16.362426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:16.500299 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:16.508752 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:16.510261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:16.511999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b5ca47ff-1434-472c-9f81-d4c451443718 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.163946 Jun 02 13:32:16.512552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 543/1134] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:16 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:32:17.529116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:17.529728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:17.536737 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:17.537289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:17.538140 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:17.538650 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:17.669541 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:17.677635 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:17.683994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:17.683994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ec8d0b5-9a7b-41ad-a674-5dcf1aa40391 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1721 microversion: 2.20 time: 0.155154 Jun 02 13:32:17.683994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 592/1135] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:17 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:32:18.359971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-c00f7f25-a073-4477-823c-5d5482228808 req-51837c2b-9224-4ae4-ac57-242cb9328047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f55ba0-d5a3-4df2-90aa-458eea757132", "name": "network-vif-deleted", "tag": "76359ea2-5b91-4226-b8f7-bd586b4213c6"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:32:18.378774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c00f7f25-a073-4477-823c-5d5482228808 req-51837c2b-9224-4ae4-ac57-242cb9328047 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:18.378774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-c00f7f25-a073-4477-823c-5d5482228808 req-51837c2b-9224-4ae4-ac57-242cb9328047 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:18.394134 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-c00f7f25-a073-4477-823c-5d5482228808 req-51837c2b-9224-4ae4-ac57-242cb9328047 service nova] Creating event network-vif-deleted:76359ea2-5b91-4226-b8f7-bd586b4213c6 for instance 36f55ba0-d5a3-4df2-90aa-458eea757132 on hv-cinder-79760 Jun 02 13:32:18.406192 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-c00f7f25-a073-4477-823c-5d5482228808 req-51837c2b-9224-4ae4-ac57-242cb9328047 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274263 Jun 02 13:32:18.407078 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 544/1136] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:32:18.700305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:18.701528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:18.708699 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:18.709404 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:18.710205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:18.710643 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:18.744408 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:18.744890 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:18.745894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lazy-loading 'fault' on Instance uuid 36f55ba0-d5a3-4df2-90aa-458eea757132 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:32:18.790498 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:18.799105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:18.802510 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37a7776277ca42eba4476242438fbf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa347af05aa4e40b5960fd0aea87c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:18.802510 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-613bba1b-77bc-4cda-8221-36641b412e38 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 200 len: 1370 microversion: 2.20 time: 0.105556 Jun 02 13:32:18.802510 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 593/1137] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:18 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:32:19.821385 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:19.823011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:19.829794 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:19.830231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:19.830995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:19.831449 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:19.848863 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 HTTP/1.1 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:32:19.851796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:19.853426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '36f55ba0-d5a3-4df2-90aa-458eea757132'} Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:32:19.854355 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:19.856120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:19.857687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:32:19.857687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-233f337a-b3ec-4bdc-9ccc-55da37a11273 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 404 len: 111 microversion: 2.20 time: 0.035267 Jun 02 13:32:19.857687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 545/1138] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:19 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:32:19.860899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bf857a8f-2ffa-4f96-a081-0bf24bee3453 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '.version_select at 0x7f5a73744e50>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:19.946667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bf857a8f-2ffa-4f96-a081-0bf24bee3453 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845145606" status: 204 len: 0 microversion: 2.20 time: 0.089561 Jun 02 13:32:19.947258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 594/1139] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jun 2 13:32:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845145606 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:32:28.374979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:28.377181 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:28.382490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:28.382929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:28.383699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:28.384163 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:28.398518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 HTTP/1.1 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:32:28.400123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.402577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '36f55ba0-d5a3-4df2-90aa-458eea757132'} Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:32:28.403639 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.405470 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.406997 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:32:28.406997 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-01c90bf8-19bd-4c61-8758-321e61a73434 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 404 len: 111 microversion: 2.20 time: 0.030947 Jun 02 13:32:28.406997 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 546/1140] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 2 13:32:28 2022] DELETE /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:32:28.411561 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:28.412202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 36f55ba0-d5a3-4df2-90aa-458eea757132] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:28.421033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:28.421486 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:28.423508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:28.423508 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:28.436594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 HTTP/1.1 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:32:28.438283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.440042 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '36f55ba0-d5a3-4df2-90aa-458eea757132'} Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:32:28.441097 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. Jun 02 13:32:28.442782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:28.447012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 36f55ba0-d5a3-4df2-90aa-458eea757132 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:32:28.447012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-129ba7d7-2356-4410-8918-4eb318c06e4b tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132" status: 404 len: 111 microversion: 2.20 time: 0.032784 Jun 02 13:32:28.447012 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 595/1141] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:28 2022] GET /compute/v2.1/servers/36f55ba0-d5a3-4df2-90aa-458eea757132 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:32:30.833543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:30.834649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:30.842842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:30.843502 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:30.844523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:30.845054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:30.863144 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 HTTP/1.1 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:32:30.865834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.868757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '384c5435-b1b4-4edb-8f58-1f8ffcf87f06'} Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:32:30.875407 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.878145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.887221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:32:30.887221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b24ba2bc-0fc2-4ced-a25f-4fecabe82af6 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 404 len: 111 microversion: 2.20 time: 0.039037 Jun 02 13:32:30.887221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 547/1142] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 2 13:32:30 2022] DELETE /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 13:32:30.887589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:30.887589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] [instance: 384c5435-b1b4-4edb-8f58-1f8ffcf87f06] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:30.889718 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:30.890167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:30.890935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:30.891420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:30.906033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] HTTP exception thrown: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Request method failure captured: Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 HTTP/1.1 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLkencjoexC2QF6GQjhbNwv8R_fZVQhRqaI7o8Y765qqLGpboZXaNA-_jHDbGmW-sKJCZ7hvtl_n4E3GHpLv1QmOUFLmnkedkVJYCDsVAwSW2maGuWe7fF9T9UhddUZSaXbiTUIoZKfXKLJuoVAJKMWkfAL8GlzKPpdIievOrBH4QHs Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:32:30.907623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/afa347af05aa4e40b5960fd0aea87c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_afa347af05aa4e40b5960fd0aea87c54"}]}] Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: afa347af05aa4e40b5960fd0aea87c54 Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135928630 Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 37a7776277ca42eba4476242438fbf6d Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135928630-project Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.910253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '384c5435-b1b4-4edb-8f58-1f8ffcf87f06'} Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:32:30.911851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. Jun 02 13:32:30.915771 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:32:30.918138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] Returning 404 to user: Instance 384c5435-b1b4-4edb-8f58-1f8ffcf87f06 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:32:30.918138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-813ea4e1-aebd-4e67-b81f-e0718f3f7383 tempest-AttachVolumeShelveTestJSON-135928630 tempest-AttachVolumeShelveTestJSON-135928630-project] 10.222.0.46 "GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06" status: 404 len: 111 microversion: 2.20 time: 0.033397 Jun 02 13:32:30.918138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 596/1143] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 2 13:32:30 2022] GET /compute/v2.1/servers/384c5435-b1b4-4edb-8f58-1f8ffcf87f06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 13:32:44.047723 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.048637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.168486 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-078ef0fe-3006-46f7-a6fa-737dc54bf170 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: .version_select at 0x7f5a81152ee0>, body: {"keypair": {"name": "tempest-keypair-670115935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvl0FLNRfWqTftq7snZLNgwN0pkTuApHOf+LIiHhnjG0s0nSiWRSoKvcWez0QUNkUJ1H3A/vZ2vmx6I63TDmXCU34u0zQVPs8gMObnlD1KZHdTW17LPrQYAWCzPARDDWw=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:32:44.185377 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-078ef0fe-3006-46f7-a6fa-737dc54bf170 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:32:44.191302 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-078ef0fe-3006-46f7-a6fa-737dc54bf170 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:32:44.434337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-078ef0fe-3006-46f7-a6fa-737dc54bf170 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.391162 Jun 02 13:32:44.442650 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 548/1144] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:32:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:32:47.835438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1216344237", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a773856c-12bb-470d-ae6c-e26b05167e80"}], "security_groups": [{"name": "tempest-securitygroup--659261756"}], "key_name": "tempest-keypair-670115935", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:32:47.848632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.849704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=30 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.990138 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] validate_networks() for [('a773856c-12bb-470d-ae6c-e26b05167e80', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:32:48.778965 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:32:48.779405 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:32:48.780200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:32:48.780342 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:32:48.780750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:32:48.790551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:48.791736 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:48.792751 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:48.793185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:48.812843 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:32:48.817512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:32:48.831253 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:32:48.834370 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:32:48.931514 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-af2d2670-bd1c-47c4-b649-c709b6334308 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.101919 Jun 02 13:32:48.933105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 597/1145] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:32:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:32:48.943834 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c862650a-3fbb-4b63-8771-be033baf7c3f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:48.944527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c862650a-3fbb-4b63-8771-be033baf7c3f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:49.020629 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c862650a-3fbb-4b63-8771-be033baf7c3f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:49.031382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c862650a-3fbb-4b63-8771-be033baf7c3f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1241 microversion: 2.1 time: 0.091834 Jun 02 13:32:49.032812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 549/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:48 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:32:50.050889 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-692aed88-695d-4478-b629-130be48af6f4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:50.051488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-692aed88-695d-4478-b629-130be48af6f4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:50.106648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-692aed88-695d-4478-b629-130be48af6f4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:50.114921 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-692aed88-695d-4478-b629-130be48af6f4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1241 microversion: 2.1 time: 0.068492 Jun 02 13:32:50.118378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 598/1147] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:50 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:51.131460 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:51.132113 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:51.139609 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:51.140143 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:51.140935 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:51.141378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:51.205255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:51.213814 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-52bf556e-9467-490b-b793-9cc113fc28fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1293 microversion: 2.1 time: 0.085652 Jun 02 13:32:51.214397 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 550/1148] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:51 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:52.231521 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:52.232348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:52.238846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:52.239287 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:52.240117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:52.240998 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:52.445459 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:52.467802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1e70f50c-aaa0-4d76-b5e4-2c629aa4d794 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.239851 Jun 02 13:32:52.469781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 599/1149] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:52 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:53.360008 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-80f22457-a3a2-4b1d-b0ab-5035a8b0d689 req-d2afe6f5-7268-4062-9b78-7a214b827a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae99ef6-c65f-4b4e-81b2-33317c2244c0", "tag": "b57cf993-311e-4707-99d0-398c263e6a1f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:32:53.370624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-80f22457-a3a2-4b1d-b0ab-5035a8b0d689 req-d2afe6f5-7268-4062-9b78-7a214b827a2e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:53.371082 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-80f22457-a3a2-4b1d-b0ab-5035a8b0d689 req-d2afe6f5-7268-4062-9b78-7a214b827a2e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:53.389129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-80f22457-a3a2-4b1d-b0ab-5035a8b0d689 req-d2afe6f5-7268-4062-9b78-7a214b827a2e service nova] Creating event network-changed:b57cf993-311e-4707-99d0-398c263e6a1f for instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 on hv-cinder-79760 Jun 02 13:32:53.395978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-80f22457-a3a2-4b1d-b0ab-5035a8b0d689 req-d2afe6f5-7268-4062-9b78-7a214b827a2e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039577 Jun 02 13:32:53.397548 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 551/1150] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:32:53.486153 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:53.487513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:53.496243 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:53.496700 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:53.497485 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:53.497929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:53.652773 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:53.660834 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b258f5d9-aae0-4f0f-8c98-91212fc93f02 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.178785 Jun 02 13:32:53.662729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 600/1151] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:53 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:32:54.679069 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:54.679771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:54.686585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:54.687032 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:54.687796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:54.688264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:54.817527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:54.825563 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b5d5974-cf24-427f-bcb9-63a241108656 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.151292 Jun 02 13:32:54.826128 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 552/1152] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:54 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:55.842760 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:55.843373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:55.849971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:55.850420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:55.851177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:55.851609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:55.982137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:55.989509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-49eeaa92-f751-4ffd-a686-7de91a7c8bfd tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.151188 Jun 02 13:32:55.990069 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 601/1153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:55 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:57.006295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:57.006939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:57.013554 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:57.013999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:57.014766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:57.015204 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:57.486085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:57.493520 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-837f764c-c7ef-4df1-8b63-d3c49ba0e7c2 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.491179 Jun 02 13:32:57.495145 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 553/1154] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:57 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:58.510562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:58.511176 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:58.517709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:58.518163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:58.518987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:58.519432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:58.652095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:58.659720 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7825cc47-8b9b-4a09-815e-930dbb313605 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.153071 Jun 02 13:32:58.660321 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 602/1155] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:58 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:59.676931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:32:59.677590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:32:59.679981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:59.685054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:59.685517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:59.686282 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:32:59.686717 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:32:59.823462 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:32:59.830803 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-23e974c0-2c87-4489-8dcf-d01aad0fcea4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.157754 Jun 02 13:32:59.831363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 554/1156] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:32:59 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:00.848566 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:00.849173 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:00.851017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.852178 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=8 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.856994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:00.861599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:00.861599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:00.861599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:00.991924 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:01.000174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-296b8fdb-c17d-424a-b718-5619bad123cf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.155270 Jun 02 13:33:01.001066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 603/1157] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:00 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:02.024934 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:02.026085 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:02.032782 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:02.033040 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:02.033813 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:02.034254 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:02.163742 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:02.171797 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c66faf97-c946-4d1b-881a-555792b8c008 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.150885 Jun 02 13:33:02.172389 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 555/1158] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:02 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:33:02.407848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-95f4df2c-f5de-45b9-a5e5-176d0fb8a70c req-4bc01819-bb12-408d-a67a-8d3138c46e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae99ef6-c65f-4b4e-81b2-33317c2244c0", "name": "network-vif-plugged", "status": "completed", "tag": "b57cf993-311e-4707-99d0-398c263e6a1f"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:02.417131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95f4df2c-f5de-45b9-a5e5-176d0fb8a70c req-4bc01819-bb12-408d-a67a-8d3138c46e48 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:02.417618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95f4df2c-f5de-45b9-a5e5-176d0fb8a70c req-4bc01819-bb12-408d-a67a-8d3138c46e48 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:02.429242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-95f4df2c-f5de-45b9-a5e5-176d0fb8a70c req-4bc01819-bb12-408d-a67a-8d3138c46e48 service nova] Creating event network-vif-plugged:b57cf993-311e-4707-99d0-398c263e6a1f for instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 on hv-cinder-79760 Jun 02 13:33:02.434275 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-95f4df2c-f5de-45b9-a5e5-176d0fb8a70c req-4bc01819-bb12-408d-a67a-8d3138c46e48 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030223 Jun 02 13:33:02.434813 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 604/1159] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:03.188824 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:03.189440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:03.196026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:03.196475 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:03.197771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:03.198211 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:03.332981 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:03.341735 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bd792a21-9be9-4063-941b-410b5c109ebb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.156758 Jun 02 13:33:03.342328 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 556/1160] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:03 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:04.360818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:04.361355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:04.368033 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:04.368396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:04.369163 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:04.369602 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:04.449835 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1582079557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160009625", "security_groups": [{"name": "tempest-secgroup-smoke-705320696"}], "block_device_mapping_v2": [{"uuid": "464efe28-b0b8-40d6-8075-e7a70934717e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "078003a7-efc0-4857-99dc-d1c589b32c88"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:04.533124 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:04.541671 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eaf47a4e-6067-41a5-b335-748a04777edb tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1366 microversion: 2.1 time: 0.186057 Jun 02 13:33:04.542399 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 605/1161] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:04 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:33:04.576527 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] validate_networks() for [('078003a7-efc0-4857-99dc-d1c589b32c88', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:33:05.042297 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:33:05.042713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:33:05.043180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:33:05.043611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:33:05.044055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:33:05.053331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.053779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.054773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.054987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.071864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:33:05.075956 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Getting quotas for user 14bd9be0202b433cb1fa8be6afee8ee5 and project 05cc8cf8ca8a43a1bacdc454652cfde2. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:33:05.152820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:33:05.152820 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='464efe28-b0b8-40d6-8075-e7a70934717e',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:33:05.558934 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:05.559526 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:05.566174 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.566620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.567384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.567817 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.611020 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-01b9aa4d-c398-4924-a8e0-f2ceb5ff1a8a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.165505 Jun 02 13:33:05.612387 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 557/1162] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:33:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:33:05.622522 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c816ec23-b698-4d30-a16b-dc87c4f57e63 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:05.623135 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c816ec23-b698-4d30-a16b-dc87c4f57e63 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:05.680705 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c816ec23-b698-4d30-a16b-dc87c4f57e63 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:05.688558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c816ec23-b698-4d30-a16b-dc87c4f57e63 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1094 microversion: 2.1 time: 0.069408 Jun 02 13:33:05.688822 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 558/1163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:05 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:05.711094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:05.719298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9a623a80-a47a-49bc-9529-7a5c62d31b3d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1556 microversion: 2.1 time: 0.164732 Jun 02 13:33:05.719901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 606/1164] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:05 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:05.736065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:05.736569 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:05.743053 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.743498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.744322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:05.744757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:05.827060 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-db1a1a43-442c-4a69-9fde-55218a9e709b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094840 Jun 02 13:33:05.827663 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 559/1165] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:33:05 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:06.704739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:06.705351 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:06.712120 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:06.712502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:06.713279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:06.713704 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:06.778534 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:06.786161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-39ddf211-f356-42e9-8b0d-f63b582b08da tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1144 microversion: 2.1 time: 0.085193 Jun 02 13:33:06.787075 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 607/1166] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:06 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:06.869739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-5ed9a77c-5b19-41cb-acd9-1f80c6624a4c req-6a0d7f4f-867e-4da7-90f7-3ac7f7749c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae99ef6-c65f-4b4e-81b2-33317c2244c0", "tag": "b57cf993-311e-4707-99d0-398c263e6a1f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:06.878648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5ed9a77c-5b19-41cb-acd9-1f80c6624a4c req-6a0d7f4f-867e-4da7-90f7-3ac7f7749c4e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:06.879101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5ed9a77c-5b19-41cb-acd9-1f80c6624a4c req-6a0d7f4f-867e-4da7-90f7-3ac7f7749c4e service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:06.890495 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-5ed9a77c-5b19-41cb-acd9-1f80c6624a4c req-6a0d7f4f-867e-4da7-90f7-3ac7f7749c4e service nova] Creating event network-changed:b57cf993-311e-4707-99d0-398c263e6a1f for instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 on hv-cinder-79760 Jun 02 13:33:06.896402 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-5ed9a77c-5b19-41cb-acd9-1f80c6624a4c req-6a0d7f4f-867e-4da7-90f7-3ac7f7749c4e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Jun 02 13:33:06.896843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 560/1167] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:07.807531 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:07.808558 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:07.819131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:07.819796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:07.821450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:07.822129 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:07.893215 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:07.902118 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1c38fc71-f8f0-43b5-8a6d-1072c3357ff2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1200 microversion: 2.1 time: 0.101049 Jun 02 13:33:07.902932 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 608/1168] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:07 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:08.920694 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:08.921311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:08.928876 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:08.929672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:08.930641 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:08.931076 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:09.159630 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:09.167652 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11a469d3-26de-4ed5-a082-3885f8ce2b9d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1277 microversion: 2.1 time: 0.251953 Jun 02 13:33:09.168288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 561/1169] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:08 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:09.654401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-c4caa5fb-0f83-43a9-a4f0-bfea0de3d63d req-338b2627-58cc-4b0e-a471-f03bfc18f251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec9f3f1-5df8-441f-ad96-2cc324a38643", "tag": "ccf1722d-1091-4fa8-a729-4c125d99326a"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:09.665313 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-c4caa5fb-0f83-43a9-a4f0-bfea0de3d63d req-338b2627-58cc-4b0e-a471-f03bfc18f251 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:09.666325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-c4caa5fb-0f83-43a9-a4f0-bfea0de3d63d req-338b2627-58cc-4b0e-a471-f03bfc18f251 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:09.681725 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-c4caa5fb-0f83-43a9-a4f0-bfea0de3d63d req-338b2627-58cc-4b0e-a471-f03bfc18f251 service nova] Creating event network-changed:ccf1722d-1091-4fa8-a729-4c125d99326a for instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 on hv-cinder-79760 Jun 02 13:33:09.687263 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-c4caa5fb-0f83-43a9-a4f0-bfea0de3d63d req-338b2627-58cc-4b0e-a471-f03bfc18f251 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041781 Jun 02 13:33:09.692989 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 609/1170] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:10.188902 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:10.189529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:10.196359 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:10.196809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:10.198169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:10.198608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:10.424208 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:10.433552 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-67ef655f-a42d-49cd-84ff-0e9be35a9034 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.248268 Jun 02 13:33:10.434148 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 562/1171] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:10 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:11.451433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:11.452145 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:11.459316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:11.459769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:11.460565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:11.461009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:11.598141 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:11.606335 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff72389c-1d94-4f15-af36-ff2b45456f31 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.159115 Jun 02 13:33:11.606896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 610/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:11 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:12.623507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:12.624141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:12.631018 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:12.631469 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:12.632320 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:12.632748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:12.765046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:12.772689 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c30c5002-7e92-4a8a-be45-a7a7c9cacb3e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.153706 Jun 02 13:33:12.773261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 563/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:12 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:13.789618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:13.790183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:13.796640 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:13.797090 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:13.797851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:13.798285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:13.932720 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:13.940606 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-344d7133-9244-465a-825e-d8836c1af548 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.154905 Jun 02 13:33:13.941196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 611/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:13 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:14.958971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:14.959701 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:14.963019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.969285 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:14.969809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:14.970786 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:14.971327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:14.976952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=65 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.066874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.118400 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:15.127349 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3361f880-feaa-4b16-9f5a-2b84ed6b0691 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.172858 Jun 02 13:33:15.127941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 564/1175] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:14 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:16.143810 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:16.144432 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:16.151029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:16.151475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:16.152267 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:16.152703 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:16.285362 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:16.293046 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5ec77c2f-1de0-4e00-9e2e-98906fb72af0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.153142 Jun 02 13:33:16.293615 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 612/1176] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:16 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:33:17.309754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:17.310378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:17.312779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:17.318419 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:17.318867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:17.319631 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:17.320099 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:17.453969 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:17.461754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1ad67ef7-fa5d-46ac-9e62-b1ae6ff483d5 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.155935 Jun 02 13:33:17.462326 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 565/1177] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:17 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:18.478318 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:18.478974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:18.481752 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.487388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:18.487907 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:18.488766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:18.489221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:18.494557 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=79 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.629187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:18.637367 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c92230eb-3206-478b-971a-234678142bce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.163126 Jun 02 13:33:18.642030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 613/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:18 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:19.654124 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:19.654672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:19.661559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:19.662002 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:19.662762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:19.663189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:19.797929 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:19.805383 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9aa548e1-48a7-4285-bb8f-b6f6fe81ade4 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.155235 Jun 02 13:33:19.805953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 566/1179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:19 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:20.552022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e3746b29-696b-4bc7-aac9-4159808b0c10 req-d68b0295-e0f4-464a-a1d0-d7890645851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec9f3f1-5df8-441f-ad96-2cc324a38643", "name": "network-vif-plugged", "status": "completed", "tag": "ccf1722d-1091-4fa8-a729-4c125d99326a"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:20.561608 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e3746b29-696b-4bc7-aac9-4159808b0c10 req-d68b0295-e0f4-464a-a1d0-d7890645851a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:20.562060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e3746b29-696b-4bc7-aac9-4159808b0c10 req-d68b0295-e0f4-464a-a1d0-d7890645851a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:20.573791 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e3746b29-696b-4bc7-aac9-4159808b0c10 req-d68b0295-e0f4-464a-a1d0-d7890645851a service nova] Creating event network-vif-plugged:ccf1722d-1091-4fa8-a729-4c125d99326a for instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 on hv-cinder-79760 Jun 02 13:33:20.578769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e3746b29-696b-4bc7-aac9-4159808b0c10 req-d68b0295-e0f4-464a-a1d0-d7890645851a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030807 Jun 02 13:33:20.584899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 614/1180] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:20.824329 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:20.825093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:20.831745 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:20.832259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:20.833026 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:20.833720 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:20.996985 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:21.008149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-58166d9a-f4e7-4a85-ae02-83127210c62e tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.185129 Jun 02 13:33:21.008149 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 567/1181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:20 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:22.022860 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:22.023575 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:22.030419 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:22.030868 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:22.031619 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:22.032078 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:22.172284 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:22.180031 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-450c1959-85d4-4da6-9301-d98cf4c8110f tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1265 microversion: 2.1 time: 0.161953 Jun 02 13:33:22.180599 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 615/1182] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:22 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:23.197480 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:23.198084 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:23.204608 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:23.205046 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:23.205802 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:23.206266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:23.341006 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:23.348611 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-afc46c0a-0ad4-43d3-ad58-c62ac9bda1d0 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1452 microversion: 2.1 time: 0.155638 Jun 02 13:33:23.353840 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 568/1183] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:23 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:23.365620 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:23.366273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:23.373303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:23.373761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:23.374493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:23.374922 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:23.512509 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:23.520464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9a507c05-29e8-4b35-98ba-fa2cf69ea5b1 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1452 microversion: 2.1 time: 0.158678 Jun 02 13:33:23.521044 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 616/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:23 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:25.861264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f277ae19-27ff-49a7-bcb3-f246e8597501 req-d020298a-6af4-48cf-a05b-d8c2ed9a3ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec9f3f1-5df8-441f-ad96-2cc324a38643", "tag": "ccf1722d-1091-4fa8-a729-4c125d99326a"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:25.869908 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f277ae19-27ff-49a7-bcb3-f246e8597501 req-d020298a-6af4-48cf-a05b-d8c2ed9a3ee9 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:25.870409 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f277ae19-27ff-49a7-bcb3-f246e8597501 req-d020298a-6af4-48cf-a05b-d8c2ed9a3ee9 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:25.883788 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f277ae19-27ff-49a7-bcb3-f246e8597501 req-d020298a-6af4-48cf-a05b-d8c2ed9a3ee9 service nova] Creating event network-changed:ccf1722d-1091-4fa8-a729-4c125d99326a for instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 on hv-cinder-79760 Jun 02 13:33:25.888859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f277ae19-27ff-49a7-bcb3-f246e8597501 req-d020298a-6af4-48cf-a05b-d8c2ed9a3ee9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031284 Jun 02 13:33:25.894696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 569/1185] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:39.855649 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=11 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.856251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:39.856595 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:39.856792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=31 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.858696 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=7 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.859478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=19 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.864464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:39.864912 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:39.865748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:39.866181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:39.892970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:33:39.995796 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b5ec2331-1eb1-4f79-81f3-ed575999aa44 req-e46b1654-1ee6-480c-a5e7-5ccde86820aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:40.004054 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b5ec2331-1eb1-4f79-81f3-ed575999aa44 req-e46b1654-1ee6-480c-a5e7-5ccde86820aa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:40.004500 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b5ec2331-1eb1-4f79-81f3-ed575999aa44 req-e46b1654-1ee6-480c-a5e7-5ccde86820aa service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:40.018096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b5ec2331-1eb1-4f79-81f3-ed575999aa44 req-e46b1654-1ee6-480c-a5e7-5ccde86820aa service nova] Creating event network-changed:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:33:40.023287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b5ec2331-1eb1-4f79-81f3-ed575999aa44 req-e46b1654-1ee6-480c-a5e7-5ccde86820aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169153 Jun 02 13:33:40.023896 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 570/1186] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:40.241623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-79a6ebb1-d698-4fb4-8804-953b0fbdfbd4 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 204 len: 0 microversion: 2.1 time: 0.390196 Jun 02 13:33:40.242279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 617/1187] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:33:39 2022] DELETE /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:33:40.251072 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:40.251769 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:40.257988 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:40.258433 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:40.259229 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:40.259664 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:40.398452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:40.406114 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-50bddbdd-297f-4337-acff-5016a1861003 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.159207 Jun 02 13:33:40.406747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 571/1188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:40 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:41.425578 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:41.426305 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:41.433495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:41.433942 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:41.434916 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:41.435125 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:41.843809 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:41.853202 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-831e1da4-31d7-4174-844d-c631b84b3811 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1568 microversion: 2.1 time: 0.431875 Jun 02 13:33:41.853870 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 618/1189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:41 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:42.860855 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-a521aeee-6444-4102-8ed4-c6f3f9bb4673 req-15636547-fecc-4ed3-a8bc-bc515dde3465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2546d8-4a45-4698-8a8c-b3433197ebfb", "name": "network-vif-deleted", "tag": "9204fa1b-d8e8-470b-9127-2f021bde1745"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:33:42.869403 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a521aeee-6444-4102-8ed4-c6f3f9bb4673 req-15636547-fecc-4ed3-a8bc-bc515dde3465 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:42.869848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a521aeee-6444-4102-8ed4-c6f3f9bb4673 req-15636547-fecc-4ed3-a8bc-bc515dde3465 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:42.870407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:42.871052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:42.877766 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:42.878221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:42.879039 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:42.879429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:42.880774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-a521aeee-6444-4102-8ed4-c6f3f9bb4673 req-15636547-fecc-4ed3-a8bc-bc515dde3465 service nova] Creating event network-vif-deleted:9204fa1b-d8e8-470b-9127-2f021bde1745 for instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb on hv-cinder-79760 Jun 02 13:33:42.886280 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-a521aeee-6444-4102-8ed4-c6f3f9bb4673 req-15636547-fecc-4ed3-a8bc-bc515dde3465 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 Jun 02 13:33:42.886908 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 572/1190] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:33:42.943650 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:42.952235 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a2f8fb52-438d-4401-a4af-ae9188c69d6d tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1382 microversion: 2.1 time: 0.085930 Jun 02 13:33:42.952808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 619/1191] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:42 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:33:43.970313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:43.971011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:43.977311 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:43.977755 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:43.978518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:43.978951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:44.011159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:44.011585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:44.012058 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lazy-loading 'fault' on Instance uuid 9a2546d8-4a45-4698-8a8c-b3433197ebfb {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:33:44.052137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8446bcbe46d041789a0a7c5c270fd7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:33:44.060189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-18f4da85-697a-4c3e-a131-719da6cb9aaf tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 200 len: 1223 microversion: 2.1 time: 0.094608 Jun 02 13:33:44.064501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 573/1192] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:43 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:45.077788 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:45.078397 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] [instance: 9a2546d8-4a45-4698-8a8c-b3433197ebfb] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:33:45.085214 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:45.085663 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:45.086421 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:33:45.087438 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:33:45.100600 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] HTTP exception thrown: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Request method failure captured: Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb HTTP/1.1 Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLrZx5n6fcKEeEEqFIxaajXIPXWeCdx0KhRxoYukThzQ-Avk7ODMhI0xQ3-VDmNwkxhI1H1oBSYjEM_7QcvtJOVC0oeRCbAFtiScmf-AwX5hbAF-6zBNbkIbDEfpWRMvvWbKc_zNCIg99kyyWvgrTZxjePxnutMPYz5sudn7m6ekR1I Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: a67e5bfde6ef4a358150b1ba035d5f1a Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestShelveInstance-2133161399 Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:33:45.102770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a67e5bfde6ef4a358150b1ba035d5f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a67e5bfde6ef4a358150b1ba035d5f1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a67e5bfde6ef4a358150b1ba035d5f1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a67e5bfde6ef4a358150b1ba035d5f1a"}]}] Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestShelveInstance-2133161399 Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: a67e5bfde6ef4a358150b1ba035d5f1a Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestShelveInstance-2133161399 Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-TestShelveInstance-2133161399-project Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 8446bcbe46d041789a0a7c5c270fd7ef Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestShelveInstance-2133161399-project Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. Jun 02 13:33:45.104468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '9a2546d8-4a45-4698-8a8c-b3433197ebfb'} Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:33:45.105484 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. Jun 02 13:33:45.107047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:33:45.108533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Returning 404 to user: Instance 9a2546d8-4a45-4698-8a8c-b3433197ebfb could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:33:45.108533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-41fd1708-5dd5-40be-be99-2845b0858aa2 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb" status: 404 len: 111 microversion: 2.1 time: 0.030449 Jun 02 13:33:45.108533 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 620/1193] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:33:45 2022] GET /compute/v2.1/servers/9a2546d8-4a45-4698-8a8c-b3433197ebfb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:33:45.380962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-86dc175d-58e9-43e7-9956-4d69b7ad2d59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] Calling method '.version_select at 0x7f5a804c4430>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:33:45.520455 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-86dc175d-58e9-43e7-9956-4d69b7ad2d59 tempest-TestShelveInstance-2133161399 tempest-TestShelveInstance-2133161399-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-872029292" status: 202 len: 0 microversion: 2.1 time: 0.143369 Jun 02 13:33:45.521064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 574/1194] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 2 13:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-872029292 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:34:21.862994 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:21.863594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:21.865765 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:21.866494 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:21.871954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:21.879479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:21.879479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:21.879479 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:21.896373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e0d7f198-b7a6-46b8-b854-e7d25034d48a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/ips" status: 200 len: 149 microversion: 2.1 time: 0.037245 Jun 02 13:34:21.896975 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 621/1195] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:34:21 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:34:23.591898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91e45ed2-a069-480d-8775-88c1bb3bcbe9"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:23.592955 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:23.595100 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=18 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:23.595757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:23.602612 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:23.603064 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:23.603830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:23.604295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:24.261240 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-780fdafe-b78e-4b20-a6c5-c22586c4e08b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673354 Jun 02 13:34:24.261885 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 575/1196] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:34:23 2022] POST /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:34:31.776167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a5cfdd26-c86b-44cd-ace4-cc0e687fb746 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: .version_select at 0x7f5a8560b3a0>, body: {"keypair": {"name": "tempest-keypair-645125188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIpBropI0KMCAb+4yjHbZo+qgw7gsrd7FlSME/1pylGh1ylZIHCtn03zTN827TjFLV6T8xQGZ6emvtlwbsmHPw+8yTYFEqBv81uDylAMPXpUjAAnfcb2k9+HgHPPsnF3g=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:31.792403 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-a5cfdd26-c86b-44cd-ace4-cc0e687fb746 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:34:31.796598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-a5cfdd26-c86b-44cd-ace4-cc0e687fb746 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:34:31.892654 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a5cfdd26-c86b-44cd-ace4-cc0e687fb746 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122322 Jun 02 13:34:31.893264 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 622/1197] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:34:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:34.422576 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:34.423333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:34.427838 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2018704232", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a773856c-12bb-470d-ae6c-e26b05167e80"}], "security_groups": [{"name": "tempest-securitygroup--1681261345"}], "key_name": "tempest-keypair-645125188", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:34.534871 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] validate_networks() for [('a773856c-12bb-470d-ae6c-e26b05167e80', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:34:34.909110 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:34:34.909543 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:34:34.910016 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:34:34.910424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:34:34.910867 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:34:34.925690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:34.926133 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:34.926927 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:34.927358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:34.946227 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:34:34.950806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:34:34.963224 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:34:34.965715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:34:35.094261 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f221dc94-1e47-46e1-9d65-5a25a08de1b9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.673004 Jun 02 13:34:35.094924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 576/1198] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:34:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:34:35.112655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f4906a87-6922-4938-9b31-256d330f3412 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:35.113835 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f4906a87-6922-4938-9b31-256d330f3412 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:35.182741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f4906a87-6922-4938-9b31-256d330f3412 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:35.191133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f4906a87-6922-4938-9b31-256d330f3412 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1241 microversion: 2.1 time: 0.088595 Jun 02 13:34:35.191812 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 623/1199] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:35 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:36.216442 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:36.217607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:36.228925 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:36.229374 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:36.230172 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:36.230613 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:36.302312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:36.311581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8c01c1a2-6a10-44b8-b028-5966d59d9a58 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1245 microversion: 2.1 time: 0.102365 Jun 02 13:34:36.312361 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 577/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:36 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:37.329778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:37.330696 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:37.339244 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:37.339794 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:37.340569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:37.341009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:37.446065 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:37.464103 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c8e50ac-2a0c-4943-bfa2-e3a93527808b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1301 microversion: 2.1 time: 0.137767 Jun 02 13:34:37.465813 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 624/1201] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:37 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1301 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:38.487739 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:38.488476 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:38.495358 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:38.495915 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:38.496753 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:38.497256 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:38.708653 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:38.716795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-27a52657-f0c0-4af1-8013-e1107da9add1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.232996 Jun 02 13:34:38.717386 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 578/1202] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:38 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:39.148846 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-706314f7-7fe0-4b84-a40f-5599b40fbbca req-27ac4944-1d95-49da-9db3-b399e3bce6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2fb338d-8340-4489-8034-41952c9ec287", "tag": "ab0b7f04-dba2-40f0-8368-7859cdf7a42e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:39.158054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-706314f7-7fe0-4b84-a40f-5599b40fbbca req-27ac4944-1d95-49da-9db3-b399e3bce6d2 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:39.158572 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-706314f7-7fe0-4b84-a40f-5599b40fbbca req-27ac4944-1d95-49da-9db3-b399e3bce6d2 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:39.171292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-706314f7-7fe0-4b84-a40f-5599b40fbbca req-27ac4944-1d95-49da-9db3-b399e3bce6d2 service nova] Creating event network-changed:ab0b7f04-dba2-40f0-8368-7859cdf7a42e for instance e2fb338d-8340-4489-8034-41952c9ec287 on hv-cinder-79760 Jun 02 13:34:39.176580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-706314f7-7fe0-4b84-a40f-5599b40fbbca req-27ac4944-1d95-49da-9db3-b399e3bce6d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031419 Jun 02 13:34:39.177188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 625/1203] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:39.737959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:39.738686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:39.746382 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:39.746830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:39.747619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:39.748096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:40.078643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:40.087262 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e65a5714-6674-4dfe-997d-8c0f7114c5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.353091 Jun 02 13:34:40.087852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 579/1204] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:39 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:41.105551 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:41.106242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:41.112549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:41.113748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:41.114177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:41.249084 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:41.256579 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-713aa5dd-d3f5-402c-8d16-0d7fe4287d21 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.156416 Jun 02 13:34:41.257722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 626/1205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:41 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:42.274555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:42.275190 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:42.281775 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:42.282238 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:42.282995 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:42.283449 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:42.412585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:42.420007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-83ad63df-1509-45b1-8c68-5a183bc166e8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.150002 Jun 02 13:34:42.420577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 580/1206] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:42 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:43.437083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:43.437719 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:43.444920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:43.445366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:43.446130 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:43.446569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:43.583106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:43.591513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b9ab8716-c137-4df7-8dd4-5d52c7a8f07b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.158244 Jun 02 13:34:43.592137 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 627/1207] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:43 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:44.608468 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:44.609011 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:44.616815 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:44.617366 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:44.618324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:44.618855 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:44.770620 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:44.778913 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1d0df8f7-a0b9-482f-9c5f-fe4b64346137 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.174338 Jun 02 13:34:44.779497 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 581/1208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:44 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:45.802375 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:45.803475 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:45.810021 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:45.816739 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:45.817544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:45.818931 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:45.820139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:46.001360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:46.010032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-10ffc44b-70fd-4af3-b232-55c71cad9025 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.214619 Jun 02 13:34:46.013327 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 628/1209] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:45 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:47.031308 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:47.032345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:47.034766 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.035686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.042933 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:47.043518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:47.044747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:47.045339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:47.053227 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-d19aa9c8-1f8f-4f76-aad4-1b8d232d9201 req-53afff67-a7ec-4863-8f4f-475d56f46444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2fb338d-8340-4489-8034-41952c9ec287", "name": "network-vif-plugged", "status": "completed", "tag": "ab0b7f04-dba2-40f0-8368-7859cdf7a42e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:47.068302 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-d19aa9c8-1f8f-4f76-aad4-1b8d232d9201 req-53afff67-a7ec-4863-8f4f-475d56f46444 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:47.069212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-d19aa9c8-1f8f-4f76-aad4-1b8d232d9201 req-53afff67-a7ec-4863-8f4f-475d56f46444 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:47.088071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-d19aa9c8-1f8f-4f76-aad4-1b8d232d9201 req-53afff67-a7ec-4863-8f4f-475d56f46444 service nova] Creating event network-vif-plugged:ab0b7f04-dba2-40f0-8368-7859cdf7a42e for instance e2fb338d-8340-4489-8034-41952c9ec287 on hv-cinder-79760 Jun 02 13:34:47.095369 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-d19aa9c8-1f8f-4f76-aad4-1b8d232d9201 req-53afff67-a7ec-4863-8f4f-475d56f46444 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048340 Jun 02 13:34:47.096392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 629/1210] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:47.251528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:47.261179 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d1207986-c577-4242-863b-bf312c78e45d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.234050 Jun 02 13:34:47.262150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 582/1211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:47 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:34:48.287785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:48.289169 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:48.296420 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:48.296881 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:48.297770 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:48.298212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:48.441527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:48.450132 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-68766055-0cfc-4fbe-8c2c-515ad42c3760 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1367 microversion: 2.1 time: 0.167028 Jun 02 13:34:48.450803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 630/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:48 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:49.470111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:49.472103 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:49.480577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:49.481033 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:49.481888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:49.482325 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:49.639080 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:34:49.648971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8c3be83d-cefd-4623-9508-0d4893ff1186 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1558 microversion: 2.1 time: 0.184424 Jun 02 13:34:49.649594 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 583/1213] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:34:49 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:34:49.666436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:49.667087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:34:49.674052 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:49.674503 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:49.675310 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:49.675749 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:49.759906 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f8e5ea4-cfa8-41a7-b675-3118176ba4ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097654 Jun 02 13:34:49.760927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 631/1214] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:34:49 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:50.937346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-ff490278-a0cf-4991-aeb7-0d3d257947dd req-626b101d-71ea-4498-be58-6dd542d43262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2fb338d-8340-4489-8034-41952c9ec287", "tag": "ab0b7f04-dba2-40f0-8368-7859cdf7a42e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:34:50.948357 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ff490278-a0cf-4991-aeb7-0d3d257947dd req-626b101d-71ea-4498-be58-6dd542d43262 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:50.948938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ff490278-a0cf-4991-aeb7-0d3d257947dd req-626b101d-71ea-4498-be58-6dd542d43262 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:50.963690 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-ff490278-a0cf-4991-aeb7-0d3d257947dd req-626b101d-71ea-4498-be58-6dd542d43262 service nova] Creating event network-changed:ab0b7f04-dba2-40f0-8368-7859cdf7a42e for instance e2fb338d-8340-4489-8034-41952c9ec287 on hv-cinder-79760 Jun 02 13:34:50.969337 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-ff490278-a0cf-4991-aeb7-0d3d257947dd req-626b101d-71ea-4498-be58-6dd542d43262 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036076 Jun 02 13:34:50.970185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 584/1215] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:35:25.974115 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.976106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=42 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.981099 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:25.989194 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.990010 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:25.990180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=46 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.990360 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.990525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f0e61264-1eee-4a9a-b8b3-5400cff0a146 req-1151f3f8-4f4f-4c04-8106-84e976cb1fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec9f3f1-5df8-441f-ad96-2cc324a38643", "tag": "ccf1722d-1091-4fa8-a729-4c125d99326a"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:35:25.990769 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:25.992151 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.992895 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:26.005875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f0e61264-1eee-4a9a-b8b3-5400cff0a146 req-1151f3f8-4f4f-4c04-8106-84e976cb1fac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:26.006642 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f0e61264-1eee-4a9a-b8b3-5400cff0a146 req-1151f3f8-4f4f-4c04-8106-84e976cb1fac service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:26.028587 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:35:26.033581 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f0e61264-1eee-4a9a-b8b3-5400cff0a146 req-1151f3f8-4f4f-4c04-8106-84e976cb1fac service nova] Creating event network-changed:ccf1722d-1091-4fa8-a729-4c125d99326a for instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 on hv-cinder-79760 Jun 02 13:35:26.043661 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f0e61264-1eee-4a9a-b8b3-5400cff0a146 req-1151f3f8-4f4f-4c04-8106-84e976cb1fac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064625 Jun 02 13:35:26.045180 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 585/1216] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:35:26.492477 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-96b2332c-6c93-46d5-980b-306ef6064151 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 204 len: 0 microversion: 2.1 time: 0.519527 Jun 02 13:35:26.493434 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 632/1217] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:35:25 2022] DELETE /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:26.509301 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:26.511017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:26.521616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:26.522857 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:26.524477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:26.525249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:27.062007 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:27.072335 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4e6e99f5-2e36-46f9-b6fe-4ffd0ed64689 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1576 microversion: 2.1 time: 0.570446 Jun 02 13:35:27.073116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 586/1218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:26 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1576 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:28.093616 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:28.094317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:28.101079 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:28.101527 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:28.102291 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:28.102729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:28.397781 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:28.412549 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b928a61d-a267-48af-8636-d82fc91efbab tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1458 microversion: 2.1 time: 0.321973 Jun 02 13:35:28.413569 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 633/1219] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:28 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1458 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:28.868765 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-8e689327-2791-42e3-a926-98739a9d2c17 req-2f416feb-aa7c-46f4-bf68-9d23428f56f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec9f3f1-5df8-441f-ad96-2cc324a38643", "name": "network-vif-deleted", "tag": "ccf1722d-1091-4fa8-a729-4c125d99326a"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:35:28.880729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8e689327-2791-42e3-a926-98739a9d2c17 req-2f416feb-aa7c-46f4-bf68-9d23428f56f9 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:28.892795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8e689327-2791-42e3-a926-98739a9d2c17 req-2f416feb-aa7c-46f4-bf68-9d23428f56f9 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:28.895327 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-8e689327-2791-42e3-a926-98739a9d2c17 req-2f416feb-aa7c-46f4-bf68-9d23428f56f9 service nova] Creating event network-vif-deleted:ccf1722d-1091-4fa8-a729-4c125d99326a for instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 on hv-cinder-79760 Jun 02 13:35:28.901924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-8e689327-2791-42e3-a926-98739a9d2c17 req-2f416feb-aa7c-46f4-bf68-9d23428f56f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041604 Jun 02 13:35:28.903186 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 587/1220] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:35:29.433383 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:29.434657 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:29.443122 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:29.443577 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:29.446165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:29.446165 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:29.515206 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:29.525187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-405a7d51-9014-4add-b8a0-d637b0ca30ce tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1225 microversion: 2.1 time: 0.097110 Jun 02 13:35:29.526134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 634/1221] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:29 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:30.544235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:30.544998 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:30.552170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:30.553137 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:30.553903 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:30.554356 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:30.591353 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:30.591959 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:30.592538 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lazy-loading 'fault' on Instance uuid 2ec9f3f1-5df8-441f-ad96-2cc324a38643 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:35:30.650136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:30.657590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d3bd8f9b-307b-438e-9e02-f5d106a156fd tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 200 len: 1184 microversion: 2.1 time: 0.118178 Jun 02 13:35:30.658266 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 588/1222] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:30 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 1184 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:31.676664 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:31.677289 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 2ec9f3f1-5df8-441f-ad96-2cc324a38643] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:31.684208 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:31.684648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:31.685429 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:31.685864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:31.700779 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] HTTP exception thrown: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Request method failure captured: Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 HTTP/1.1 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLqK_ntzUvvFPKTi3GSbGPOwA3XvIY-ygSBuhDCwC3zULOoycC3y6zQmGLUGjyExbEBFvZR6C9F9nCsi5XDhxF4F2ewmSsgmW3txNsLQPsZ9AZva0bOm4iwQqwSrKtOk-zQRLyk-hw2IssMyiTbXYjHC6FrIMtzlSdfC1H6eVgyytYU Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:35:31.702702 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05cc8cf8ca8a43a1bacdc454652cfde2"}]}] Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 14bd9be0202b433cb1fa8be6afee8ee5 Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. Jun 02 13:35:31.706851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '2ec9f3f1-5df8-441f-ad96-2cc324a38643'} Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:35:31.708343 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. Jun 02 13:35:31.710281 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:31.711422 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Returning 404 to user: Instance 2ec9f3f1-5df8-441f-ad96-2cc324a38643 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:35:31.711422 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d965d132-867b-4d92-b4e1-805e421f4ec6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643" status: 404 len: 111 microversion: 2.1 time: 0.032050 Jun 02 13:35:31.711422 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 635/1223] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:31 2022] GET /compute/v2.1/servers/2ec9f3f1-5df8-441f-ad96-2cc324a38643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:35:35.237692 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-6fe591e7-f45b-4b2e-bc22-eac2b65c1ba7 req-4a1bc30f-17a4-4d5e-adde-0dd0ad5aba25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e26885-8b93-46a9-945a-596a3957445e", "tag": "bbdface1-3f0e-4266-9432-abdd2169f13c"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:35:35.241171 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:35.241992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:35.246976 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6fe591e7-f45b-4b2e-bc22-eac2b65c1ba7 req-4a1bc30f-17a4-4d5e-adde-0dd0ad5aba25 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:35.247729 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6fe591e7-f45b-4b2e-bc22-eac2b65c1ba7 req-4a1bc30f-17a4-4d5e-adde-0dd0ad5aba25 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:35.251195 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:35.251808 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:35.252882 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:35.253422 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:35.260698 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-6fe591e7-f45b-4b2e-bc22-eac2b65c1ba7 req-4a1bc30f-17a4-4d5e-adde-0dd0ad5aba25 service nova] Creating event network-changed:bbdface1-3f0e-4266-9432-abdd2169f13c for instance e8e26885-8b93-46a9-945a-596a3957445e on hv-cinder-79760 Jun 02 13:35:35.266544 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-6fe591e7-f45b-4b2e-bc22-eac2b65c1ba7 req-4a1bc30f-17a4-4d5e-adde-0dd0ad5aba25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 Jun 02 13:35:35.267167 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 636/1224] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:35:35.295979 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:35:35.742264 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1491a911-26db-4b90-84fe-3fd0f5dfd906 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 204 len: 0 microversion: 2.1 time: 0.508716 Jun 02 13:35:35.751288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 589/1225] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:35:35 2022] DELETE /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:35.759111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:35.761285 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:35.773658 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:35.774461 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:35.776060 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:35.777117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:35.937303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:35.946539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-55acc667-965b-492b-9fe7-dab40f30a0b2 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1576 microversion: 2.1 time: 0.195782 Jun 02 13:35:35.947161 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 637/1226] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:35 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:36.966048 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:36.966747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:36.973898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:36.974310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:36.975088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:36.975726 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:37.134762 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:37.142952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4f2ca218-ebb3-469a-843d-b95fc9a8620d tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1458 microversion: 2.1 time: 0.181145 Jun 02 13:35:37.143545 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 590/1227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:36 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1458 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:38.161056 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:38.161717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:38.172425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:38.172425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:38.172425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:38.172831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:38.234535 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-22c58441-2ab2-456c-940c-65f76bcdfb11 req-c70e28ba-259b-4e9f-a917-154bf8bec8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e26885-8b93-46a9-945a-596a3957445e", "name": "network-vif-deleted", "tag": "bbdface1-3f0e-4266-9432-abdd2169f13c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:35:38.251590 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-22c58441-2ab2-456c-940c-65f76bcdfb11 req-c70e28ba-259b-4e9f-a917-154bf8bec8ee service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:38.252429 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-22c58441-2ab2-456c-940c-65f76bcdfb11 req-c70e28ba-259b-4e9f-a917-154bf8bec8ee service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:38.263001 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:38.271795 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d281c566-6d07-442f-9d2a-1046841a1062 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1391 microversion: 2.1 time: 0.114359 Jun 02 13:35:38.272433 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 638/1228] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:38 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1391 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:38.273643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-22c58441-2ab2-456c-940c-65f76bcdfb11 req-c70e28ba-259b-4e9f-a917-154bf8bec8ee service nova] Creating event network-vif-deleted:bbdface1-3f0e-4266-9432-abdd2169f13c for instance e8e26885-8b93-46a9-945a-596a3957445e on hv-cinder-79760 Jun 02 13:35:38.282349 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-22c58441-2ab2-456c-940c-65f76bcdfb11 req-c70e28ba-259b-4e9f-a917-154bf8bec8ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054263 Jun 02 13:35:38.283443 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 591/1229] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:35:39.288529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:39.289106 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:39.296437 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:39.296913 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:39.298853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:39.298853 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:39.301848 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:35:39.304271 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:35:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e (ip 10.222.0.46) !!! Jun 02 13:35:39.341087 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:39.341537 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:39.341990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lazy-loading 'fault' on Instance uuid e8e26885-8b93-46a9-945a-596a3957445e {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:35:39.385852 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd9be0202b433cb1fa8be6afee8ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cc8cf8ca8a43a1bacdc454652cfde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:35:39.397680 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31479ceb-f7c0-478e-9f85-9c536d77e29b tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 200 len: 1230 microversion: 2.1 time: 0.113344 Jun 02 13:35:39.399183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 639/1230] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:39 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:40.418816 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:40.420160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: e8e26885-8b93-46a9-945a-596a3957445e] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:40.427274 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:40.427757 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:40.428549 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:40.428996 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:40.443839 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] HTTP exception thrown: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Request method failure captured: Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e HTTP/1.1 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLqK_ntzUvvFPKTi3GSbGPOwA3XvIY-ygSBuhDCwC3zULOoycC3y6zQmGLUGjyExbEBFvZR6C9F9nCsi5XDhxF4F2ewmSsgmW3txNsLQPsZ9AZva0bOm4iwQqwSrKtOk-zQRLyk-hw2IssMyiTbXYjHC6FrIMtzlSdfC1H6eVgyytYU Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:35:40.445521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05cc8cf8ca8a43a1bacdc454652cfde2"}]}] Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 14bd9be0202b433cb1fa8be6afee8ee5 Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. Jun 02 13:35:40.447130 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'e8e26885-8b93-46a9-945a-596a3957445e'} Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:35:40.448126 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. Jun 02 13:35:40.449440 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:40.450656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Returning 404 to user: Instance e8e26885-8b93-46a9-945a-596a3957445e could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:35:40.450656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-52d2e614-d3c8-46f8-9e1e-99e33fa7c0b7 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e" status: 404 len: 111 microversion: 2.1 time: 0.035515 Jun 02 13:35:40.450656 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 592/1231] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:40 2022] GET /compute/v2.1/servers/e8e26885-8b93-46a9-945a-596a3957445e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:35:41.035604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:41.040388 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:41.043981 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:41.044426 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:41.045310 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:41.045740 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:41.060015 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] HTTP exception thrown: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Request method failure captured: Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 HTTP/1.1 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLqK_ntzUvvFPKTi3GSbGPOwA3XvIY-ygSBuhDCwC3zULOoycC3y6zQmGLUGjyExbEBFvZR6C9F9nCsi5XDhxF4F2ewmSsgmW3txNsLQPsZ9AZva0bOm4iwQqwSrKtOk-zQRLyk-hw2IssMyiTbXYjHC6FrIMtzlSdfC1H6eVgyytYU Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:35:41.061728 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05cc8cf8ca8a43a1bacdc454652cfde2"}]}] Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: 14bd9be0202b433cb1fa8be6afee8ee5 Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.064179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '68a92ef8-3817-4bc0-9020-ec93a0c61dd6'} Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:35:41.069944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.072168 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.074440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Returning 404 to user: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:35:41.074440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c2c8cc39-29a1-447e-85fe-eb79b1ee98f6 tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 404 len: 111 microversion: 2.1 time: 0.032640 Jun 02 13:35:41.074440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 640/1232] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:35:41 2022] DELETE /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:35:41.075120 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:41.075778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] [instance: 68a92ef8-3817-4bc0-9020-ec93a0c61dd6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:35:41.082637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:41.083926 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:41.084821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:41.085303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:41.100244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] HTTP exception thrown: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Request method failure captured: Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 HTTP/1.1 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLqK_ntzUvvFPKTi3GSbGPOwA3XvIY-ygSBuhDCwC3zULOoycC3y6zQmGLUGjyExbEBFvZR6C9F9nCsi5XDhxF4F2ewmSsgmW3txNsLQPsZ9AZva0bOm4iwQqwSrKtOk-zQRLyk-hw2IssMyiTbXYjHC6FrIMtzlSdfC1H6eVgyytYU Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:35:41.101774 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05cc8cf8ca8a43a1bacdc454652cfde2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05cc8cf8ca8a43a1bacdc454652cfde2"}]}] Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 05cc8cf8ca8a43a1bacdc454652cfde2 Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestVolumeBootPattern-578717993 Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: 14bd9be0202b433cb1fa8be6afee8ee5 Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestVolumeBootPattern-578717993-project Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.109170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '68a92ef8-3817-4bc0-9020-ec93a0c61dd6'} Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:35:41.110559 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. Jun 02 13:35:41.112987 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:35:41.115200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Returning 404 to user: Instance 68a92ef8-3817-4bc0-9020-ec93a0c61dd6 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:35:41.115200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-151ee05b-371c-4897-9f6d-4f3f07d1e34a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6" status: 404 len: 111 microversion: 2.1 time: 0.033972 Jun 02 13:35:41.115200 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 593/1233] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:35:41 2022] GET /compute/v2.1/servers/68a92ef8-3817-4bc0-9020-ec93a0c61dd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:35:42.660775 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-44152075-9096-4a8d-8c70-24ed1f29cb2a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] Calling method '.version_select at 0x7f5a822fd040>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:35:42.805317 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-44152075-9096-4a8d-8c70-24ed1f29cb2a tempest-TestVolumeBootPattern-578717993 tempest-TestVolumeBootPattern-578717993-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-160009625" status: 202 len: 0 microversion: 2.1 time: 0.148958 Jun 02 13:35:42.805970 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 641/1234] 10.222.0.46 () {58 vars in 1259 bytes} [Thu Jun 2 13:35:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-160009625 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:36:06.402658 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:06.403136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:06.406846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.406846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.411602 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.413101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.413877 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.414339 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.439904 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6fa255c7-cf4f-4a24-afaf-f7c1e1bea14f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/ips" status: 200 len: 151 microversion: 2.1 time: 0.042563 Jun 02 13:36:06.440509 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 594/1235] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:36:06 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:06.449823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.452776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.455622 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91e45ed2-a069-480d-8775-88c1bb3bcbe9"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:06.456730 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:06.464071 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.464560 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.465353 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.465784 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.549960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/os-volume_attachments HTTP/1.1 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 74 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:36:06.552183 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {"volumeAttachment": {"volumeId": "91e45ed2-a069-480d-8775-88c1bb3bcbe9"}} Jun 02 13:36:06.554251 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'server_id': 'e2fb338d-8340-4489-8034-41952c9ec287', 'body': {'volumeAttachment': {'volumeId': '91e45ed2-a069-480d-8775-88c1bb3bcbe9'}}} Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:06.555695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:06.558373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 400 to user: Invalid volume: volume 91e45ed2-a069-480d-8775-88c1bb3bcbe9 is already attached to instances: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0d454f22-258d-4c76-b998-206cfce3ec41 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105292 Jun 02 13:36:06.560478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 642/1236] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:36:06 2022] POST /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:36:06.563349 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:06.563852 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:06.572159 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.572599 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.573364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.573798 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.600570 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:36:06.929222 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-06b52d73-761b-4b75-9a5b-8100a50e7450 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 204 len: 0 microversion: 2.1 time: 0.369486 Jun 02 13:36:06.929817 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 595/1237] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:36:06 2022] DELETE /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:06.938897 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:06.939745 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:06.948482 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.948929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:06.949891 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:06.950325 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:07.092207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:07.100464 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8fe6d58e-d6fd-40ec-88f3-32cdf94540b6 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1683 microversion: 2.1 time: 0.166149 Jun 02 13:36:07.101017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 643/1238] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:06 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:08.125864 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:08.126562 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:08.134160 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:08.134773 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:08.135660 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:08.136265 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:08.278529 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:08.288185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5eb83956-7767-4486-8e5e-3f020cfb7e99 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1683 microversion: 2.1 time: 0.166492 Jun 02 13:36:08.288842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 596/1239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:08 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:09.309436 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:09.310460 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:09.319715 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:09.320376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:09.321597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:09.322338 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:09.462402 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:09.475581 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31602bd2-fdab-4768-b03a-f44948e39bf3 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1615 microversion: 2.1 time: 0.171618 Jun 02 13:36:09.476716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 644/1240] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:09 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1615 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:09.583932 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-32c12f00-bd64-4783-95d6-55d46de1d241 req-cf48d83c-c3a6-4d34-b6bb-286b82711074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2fb338d-8340-4489-8034-41952c9ec287", "name": "network-vif-deleted", "tag": "ab0b7f04-dba2-40f0-8368-7859cdf7a42e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:09.593681 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-32c12f00-bd64-4783-95d6-55d46de1d241 req-cf48d83c-c3a6-4d34-b6bb-286b82711074 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:09.594424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-32c12f00-bd64-4783-95d6-55d46de1d241 req-cf48d83c-c3a6-4d34-b6bb-286b82711074 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:09.608000 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-32c12f00-bd64-4783-95d6-55d46de1d241 req-cf48d83c-c3a6-4d34-b6bb-286b82711074 service nova] Creating event network-vif-deleted:ab0b7f04-dba2-40f0-8368-7859cdf7a42e for instance e2fb338d-8340-4489-8034-41952c9ec287 on hv-cinder-79760 Jun 02 13:36:09.614843 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-32c12f00-bd64-4783-95d6-55d46de1d241 req-cf48d83c-c3a6-4d34-b6bb-286b82711074 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 Jun 02 13:36:09.615501 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 597/1241] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:36:10.493627 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:10.494709 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:10.503054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:10.503618 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:10.505225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:10.505999 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:10.557716 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:10.558468 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:10.559239 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'fault' on Instance uuid e2fb338d-8340-4489-8034-41952c9ec287 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:36:10.607062 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:10.616298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f0b3fe1-2336-4bba-8bdf-ddff3df0b759 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 200 len: 1331 microversion: 2.1 time: 0.127002 Jun 02 13:36:10.617139 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 645/1242] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:10 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:11.641676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:11.642437 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:11.650524 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:11.650886 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:11.651662 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:11.652142 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:11.666815 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 HTTP/1.1 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:36:11.668518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:36:11.670999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'e2fb338d-8340-4489-8034-41952c9ec287'} Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:11.672523 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:36:11.675199 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:36:11.677601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:11.677601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-55441add-0bca-435b-b9fe-a095396fcea8 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 404 len: 111 microversion: 2.1 time: 0.032728 Jun 02 13:36:11.677601 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 598/1243] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:11 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:36:11.681611 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-792cdc63-536e-481f-a7ca-e0af6fd9b34f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '.version_select at 0x7f5a737835e0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:11.770779 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-792cdc63-536e-481f-a7ca-e0af6fd9b34f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645125188" status: 202 len: 0 microversion: 2.1 time: 0.092898 Jun 02 13:36:11.771623 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 646/1244] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 2 13:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645125188 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:36:12.728992 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:12.729848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:12.741812 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:12.742647 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:12.744012 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:12.744764 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:12.863677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'services' on Instance uuid 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:36:13.127395 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-397a926e-0bb0-4e80-93c5-ef47ad0fc625 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments/91e45ed2-a069-480d-8775-88c1bb3bcbe9" status: 202 len: 0 microversion: 2.1 time: 0.406265 Jun 02 13:36:13.128259 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 599/1245] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:36:12 2022] DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments/91e45ed2-a069-480d-8775-88c1bb3bcbe9 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:36:13.139131 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:13.140465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:13.148467 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:13.148909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:13.149691 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:13.150117 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:13.184515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9f12b480-515d-4a12-9c1b-12bd5cf7ad33 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050899 Jun 02 13:36:13.185105 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 647/1246] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:36:13 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:14.202898 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:14.204577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:14.216296 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.217031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.218315 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.219013 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.272418 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-04974b7f-c48c-4b30-933f-c46ee7672e74 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077636 Jun 02 13:36:14.273388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 600/1247] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:36:14 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:36:14.338226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:14.339495 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:14.350980 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.351714 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.357196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.357196 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.386776 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:36:14.728796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-11a6a720-7156-43d0-a9fc-0e24bc2b835d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 204 len: 0 microversion: 2.1 time: 0.396588 Jun 02 13:36:14.729465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 648/1248] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:36:14 2022] DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:14.737899 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:14.739049 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:14.745728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.746189 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.746971 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:14.747410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:14.890930 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:14.899399 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d44fe83a-9297-4bfb-ad4a-4c2b5227be9d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1680 microversion: 2.1 time: 0.165242 Jun 02 13:36:14.899918 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 601/1249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:14 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:15.918290 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:15.918990 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:15.925899 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:15.926905 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:15.927676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:15.928140 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:16.068078 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:16.076095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d999889f-b668-4689-bbb6-f4f36824584c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1680 microversion: 2.1 time: 0.161935 Jun 02 13:36:16.076712 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 649/1250] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:15 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:17.093687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:17.094307 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:17.101557 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:17.102004 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:17.102790 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:17.103228 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:17.291170 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:17.301576 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e47af965-594d-4ac3-8e9f-4bb332d16586 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1680 microversion: 2.1 time: 0.211227 Jun 02 13:36:17.302201 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 602/1251] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:17 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:17.941373 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-102e7bf9-e75e-415a-a335-93f95c6ef326 req-05e49a9f-c66c-4b7c-88d3-1722a2e1f15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae99ef6-c65f-4b4e-81b2-33317c2244c0", "name": "network-vif-deleted", "tag": "b57cf993-311e-4707-99d0-398c263e6a1f"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:17.952378 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-102e7bf9-e75e-415a-a335-93f95c6ef326 req-05e49a9f-c66c-4b7c-88d3-1722a2e1f15b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:17.952818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-102e7bf9-e75e-415a-a335-93f95c6ef326 req-05e49a9f-c66c-4b7c-88d3-1722a2e1f15b service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:17.965648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-102e7bf9-e75e-415a-a335-93f95c6ef326 req-05e49a9f-c66c-4b7c-88d3-1722a2e1f15b service nova] Creating event network-vif-deleted:b57cf993-311e-4707-99d0-398c263e6a1f for instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 on hv-cinder-79760 Jun 02 13:36:17.973273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-102e7bf9-e75e-415a-a335-93f95c6ef326 req-05e49a9f-c66c-4b7c-88d3-1722a2e1f15b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Jun 02 13:36:17.973882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 650/1252] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:18.321176 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:18.322051 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:18.333953 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:18.335034 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:18.335728 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:18.336213 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:18.375098 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:18.375555 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:18.376062 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'fault' on Instance uuid 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:36:18.431477 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:18.446310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f8bc91ac-f1ab-4f01-8767-2098c11b5e7a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 200 len: 1331 microversion: 2.1 time: 0.130167 Jun 02 13:36:18.447300 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 603/1253] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:18 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:19.469839 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:19.471858 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:19.482493 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:19.483094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:19.484203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:19.485107 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:19.540515 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 HTTP/1.1 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:36:19.542855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:36:19.544656 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '9ae99ef6-c65f-4b4e-81b2-33317c2244c0'} Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:19.545500 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:36:19.547925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:36:19.550221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:19.550221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e86b51e6-44f2-49ff-bcfe-d97f72896b4b tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 404 len: 111 microversion: 2.1 time: 0.082326 Jun 02 13:36:19.550221 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 651/1254] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:19 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:36:19.561415 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-22428613-9820-43c1-9de7-bef7686cf01c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '.version_select at 0x7f5a805153a0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:19.657146 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-22428613-9820-43c1-9de7-bef7686cf01c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670115935" status: 202 len: 0 microversion: 2.1 time: 0.103406 Jun 02 13:36:19.658518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 604/1255] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 2 13:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670115935 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:36:20.592866 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b9497189-e7da-41e3-b004-b19fad90f4d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: .version_select at 0x7f5a73712790>, body: {"keypair": {"name": "tempest-keypair-1867753402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRfwz2pY3J6xvtNd18YEjXEikRre9BoOlv+L+MeoOxJhfwBKC+jmJCLF20kJknGeBD7ueBTnFeLM0v0l/raGo7eRjWOhxzYRjGLkoUdhbdEYv37R5FCNVwDfCCTO72/Gw=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:20.608450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-b9497189-e7da-41e3-b004-b19fad90f4d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:20.612655 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-b9497189-e7da-41e3-b004-b19fad90f4d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:20.729811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b9497189-e7da-41e3-b004-b19fad90f4d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141085 Jun 02 13:36:20.730407 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 652/1256] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:23.703121 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1635862735", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a773856c-12bb-470d-ae6c-e26b05167e80"}], "security_groups": [{"name": "tempest-securitygroup--1174638421"}], "key_name": "tempest-keypair-1867753402", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:23.814729 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] validate_networks() for [('a773856c-12bb-470d-ae6c-e26b05167e80', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:24.201736 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:24.202152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:24.202616 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:24.203017 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:24.203424 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:24.213787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:24.214231 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:24.215019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:24.215454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:24.234367 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:24.239401 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:24.253303 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:24.256292 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:24.541404 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dcd2239b-fc92-4c20-ab35-87c51651ce09 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.842926 Jun 02 13:36:24.541984 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 605/1257] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:36:24.558668 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-140ec88b-c7fd-48d8-b675-d889ddf85395 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:24.559264 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-140ec88b-c7fd-48d8-b675-d889ddf85395 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:24.636512 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-140ec88b-c7fd-48d8-b675-d889ddf85395 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:24.643811 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-140ec88b-c7fd-48d8-b675-d889ddf85395 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1242 microversion: 2.1 time: 0.089641 Jun 02 13:36:24.644384 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 653/1258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:24 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:25.661268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-729afb62-3ef1-43e1-a107-c9e7233fd5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:25.662141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-729afb62-3ef1-43e1-a107-c9e7233fd5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:25.719964 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-729afb62-3ef1-43e1-a107-c9e7233fd5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:25.726888 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-729afb62-3ef1-43e1-a107-c9e7233fd5e0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1242 microversion: 2.1 time: 0.069809 Jun 02 13:36:25.731055 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 606/1259] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:25 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:26.744463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:26.745200 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:26.752156 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.752621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.753481 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.753957 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.832783 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:26.846488 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-616daaeb-d90d-4c75-bc44-457133afd88a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1294 microversion: 2.1 time: 0.105514 Jun 02 13:36:26.848181 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 654/1260] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:26 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:27.866318 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:27.868210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:27.877096 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:27.877819 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:27.878889 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:27.886107 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:28.074605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:28.086940 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fa97ea1c-07c9-409f-8343-bf18dbad8e55 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.225986 Jun 02 13:36:28.087866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 607/1261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:27 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:29.114450 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:29.115110 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:29.122216 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:29.122894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:29.124229 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:29.125246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:29.251951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-47369b49-4df5-4baf-ad9b-4e68fe4fc579 req-420d348f-786b-49c0-a422-504df15b857a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60622d10-a64b-42d5-ae5c-841851ace75f", "tag": "35274d2a-2c83-4e9f-a67f-194267853643"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:29.264704 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-47369b49-4df5-4baf-ad9b-4e68fe4fc579 req-420d348f-786b-49c0-a422-504df15b857a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:29.267596 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-47369b49-4df5-4baf-ad9b-4e68fe4fc579 req-420d348f-786b-49c0-a422-504df15b857a service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:29.280060 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-47369b49-4df5-4baf-ad9b-4e68fe4fc579 req-420d348f-786b-49c0-a422-504df15b857a service nova] Creating event network-changed:35274d2a-2c83-4e9f-a67f-194267853643 for instance 60622d10-a64b-42d5-ae5c-841851ace75f on hv-cinder-79760 Jun 02 13:36:29.287990 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-47369b49-4df5-4baf-ad9b-4e68fe4fc579 req-420d348f-786b-49c0-a422-504df15b857a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045082 Jun 02 13:36:29.295029 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 608/1262] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:29.387108 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:29.403439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e0b202ef-2cc9-45b7-8103-af3e8753a736 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.293794 Jun 02 13:36:29.415574 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 655/1263] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:29 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:30.422895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:30.423607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:30.430178 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:30.430619 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:30.431388 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:30.431821 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:30.578206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:30.586686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cbc0ac86-ad1a-45ff-af00-0009b372193e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.168737 Jun 02 13:36:30.587268 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 609/1264] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:30 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:31.604529 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:31.605273 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:31.612385 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:31.612831 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:31.613646 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:31.614085 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:31.750823 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:31.760096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f6e38971-f08a-46e6-97c7-42f50a464294 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.159558 Jun 02 13:36:31.761025 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 656/1265] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:31 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:32.778698 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:32.779515 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:32.786275 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:32.786715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:32.787482 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:32.787967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:32.930102 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:32.938674 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3bb5e7ed-8ca7-4747-a994-2b7b7536c305 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.163868 Jun 02 13:36:32.939257 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 610/1266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:32 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:33.960996 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:33.962258 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:33.971058 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.971502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:33.972349 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.972782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:34.129695 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:34.143096 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a0c278d0-ec1b-4cd1-91cc-7fcd791e6945 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.189778 Jun 02 13:36:34.144127 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 657/1267] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:33 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:35.162748 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:35.163792 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:35.167498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.175770 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.176576 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.177938 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.178754 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.337101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:35.345830 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ee01bf58-9879-4b60-b9a0-3e1cd6bc0cf9 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.189092 Jun 02 13:36:35.346417 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 611/1268] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:35 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:35.489355 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.639676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-6ab815cc-359c-4cf5-8064-1ef5ea6a7dbd req-18f628ea-4b66-448f-9a46-347b151fd4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60622d10-a64b-42d5-ae5c-841851ace75f", "name": "network-vif-plugged", "status": "completed", "tag": "35274d2a-2c83-4e9f-a67f-194267853643"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:35.649308 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6ab815cc-359c-4cf5-8064-1ef5ea6a7dbd req-18f628ea-4b66-448f-9a46-347b151fd4d8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.649721 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6ab815cc-359c-4cf5-8064-1ef5ea6a7dbd req-18f628ea-4b66-448f-9a46-347b151fd4d8 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.663357 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-6ab815cc-359c-4cf5-8064-1ef5ea6a7dbd req-18f628ea-4b66-448f-9a46-347b151fd4d8 service nova] Creating event network-vif-plugged:35274d2a-2c83-4e9f-a67f-194267853643 for instance 60622d10-a64b-42d5-ae5c-841851ace75f on hv-cinder-79760 Jun 02 13:36:35.671974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-6ab815cc-359c-4cf5-8064-1ef5ea6a7dbd req-18f628ea-4b66-448f-9a46-347b151fd4d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185280 Jun 02 13:36:35.671974 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 658/1269] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:36.365781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:36.366657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:36.368364 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.373937 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:36.374378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:36.375151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:36.375583 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:36.537833 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:36.541625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.546653 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6550612f-f3ab-4776-a5a7-b79df78efdec tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.187066 Jun 02 13:36:36.547273 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 612/1270] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:36 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:37.566284 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:37.567029 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:37.574054 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.575601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.577083 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.577678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.728212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:37.735774 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c63568f7-7dbd-487e-a029-5e022edf095d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1368 microversion: 2.1 time: 0.174500 Jun 02 13:36:37.736457 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 659/1271] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:37 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:38.762478 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:38.763071 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:38.765027 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.770376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.770818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:38.771585 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.772062 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:38.942111 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:38.951452 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-962d5e68-40ee-4f01-b673-7ee2fd93f110 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1558 microversion: 2.1 time: 0.193280 Jun 02 13:36:38.952101 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 613/1272] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:38 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:38.968818 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:38.969584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:38.977501 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.977945 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:38.978732 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.979170 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:39.068685 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2ab1b82-ab2b-46d9-bef5-2b8d55f3a905 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103471 Jun 02 13:36:39.069722 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 660/1273] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:36:38 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:40.172879 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-8b32a01e-999b-4606-8f1b-039b9aa2d6b8 req-dbbf7e90-b222-4ca5-98a2-72ee98ee0133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60622d10-a64b-42d5-ae5c-841851ace75f", "tag": "35274d2a-2c83-4e9f-a67f-194267853643"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:40.189809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8b32a01e-999b-4606-8f1b-039b9aa2d6b8 req-dbbf7e90-b222-4ca5-98a2-72ee98ee0133 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:40.201434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8b32a01e-999b-4606-8f1b-039b9aa2d6b8 req-dbbf7e90-b222-4ca5-98a2-72ee98ee0133 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:40.212331 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-8b32a01e-999b-4606-8f1b-039b9aa2d6b8 req-dbbf7e90-b222-4ca5-98a2-72ee98ee0133 service nova] Creating event network-changed:35274d2a-2c83-4e9f-a67f-194267853643 for instance 60622d10-a64b-42d5-ae5c-841851ace75f on hv-cinder-79760 Jun 02 13:36:40.220569 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-8b32a01e-999b-4606-8f1b-039b9aa2d6b8 req-dbbf7e90-b222-4ca5-98a2-72ee98ee0133 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055057 Jun 02 13:36:40.221607 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 614/1274] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:55.144346 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:55.145226 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:55.205522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:55.206091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:55.212567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:55.213011 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:55.213778 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:55.214279 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:55.241864 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-64a8eecd-c188-4356-977f-2070cef314a0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/ips" status: 200 len: 150 microversion: 2.1 time: 0.099539 Jun 02 13:37:55.243101 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 661/1275] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:37:55 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/ips => generated 150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:57.984842 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:57.990598 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72269178-6aac-4437-b2ed-0a61dbb9ea17"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:57.991732 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:57.998087 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:57.998763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:57.999528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:57.999991 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:58.826569 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2d975ca3-b5e2-40c8-8e5f-9f19ec42a529 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843880 Jun 02 13:37:58.827686 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 615/1276] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:37:57 2022] POST /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:06.317593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72269178-6aac-4437-b2ed-0a61dbb9ea17"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:06.318862 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:06.327068 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.327807 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.328632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.329066 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.413505 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments HTTP/1.1 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 74 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:38:06.415250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {"volumeAttachment": {"volumeId": "72269178-6aac-4437-b2ed-0a61dbb9ea17"}} Jun 02 13:38:06.417121 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '60622d10-a64b-42d5-ae5c-841851ace75f', 'body': {'volumeAttachment': {'volumeId': '72269178-6aac-4437-b2ed-0a61dbb9ea17'}}} Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:06.421731 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:06.423366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 400 to user: Invalid volume: volume 72269178-6aac-4437-b2ed-0a61dbb9ea17 is already attached to instances: 60622d10-a64b-42d5-ae5c-841851ace75f {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e79e4829-d614-4ca8-99e4-799d766a677e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103591 Jun 02 13:38:06.425418 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 662/1277] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:38:06 2022] POST /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:38:06.480165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:06.480857 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:06.487212 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.487771 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.488626 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.493967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.568432 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'services' on Instance uuid 60622d10-a64b-42d5-ae5c-841851ace75f {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:38:06.855687 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-341f2362-cecc-4fff-9a9c-8a1e9f9cb2b4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments/72269178-6aac-4437-b2ed-0a61dbb9ea17" status: 202 len: 0 microversion: 2.1 time: 0.380148 Jun 02 13:38:06.856312 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 616/1278] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:38:06 2022] DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments/72269178-6aac-4437-b2ed-0a61dbb9ea17 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:38:06.865363 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:06.866376 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:06.873019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.873593 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.874379 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.874808 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.906067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2bad6aa6-c451-4817-83b7-cf95058d49c4 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Jun 02 13:38:06.906629 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 663/1279] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:38:06 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:07.918972 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:07.920129 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:07.926700 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.927345 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.927973 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.928412 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.958155 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2ce23db1-265d-4e0e-b15a-e8384e16269c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044126 Jun 02 13:38:07.960038 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 617/1280] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:38:07 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:38:08.015517 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:08.016094 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:08.023075 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.023563 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.024430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.024871 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.050790 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:38:08.422030 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c8c165d9-a025-42ab-90d9-c00ea4312c0e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 204 len: 0 microversion: 2.1 time: 0.410379 Jun 02 13:38:08.422632 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 664/1281] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:38:08 2022] DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:38:08.431188 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:08.431848 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:08.438632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.439633 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.440456 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.440894 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.584472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:08.592116 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1a5033b5-73b9-4b7c-b861-c1f03d1dcc9c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1683 microversion: 2.1 time: 0.164918 Jun 02 13:38:08.592684 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 618/1282] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:08 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:09.609502 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:09.610193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:09.617312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:09.617748 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:09.618576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:09.619008 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:09.760601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:09.769031 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e4d0c6b-7dd1-49af-8653-45e5152910b1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1683 microversion: 2.1 time: 0.163751 Jun 02 13:38:09.769621 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 665/1283] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:09 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:10.786454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:10.787182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:10.793999 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.794447 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.795210 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.795643 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.939067 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:10.943625 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-754c7cf6-cdcd-4cf1-99ea-c2a0bb09806c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1683 microversion: 2.1 time: 0.161675 Jun 02 13:38:10.944221 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 619/1284] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:10 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:11.198296 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-a9abfb8b-51ad-4318-ac1c-855c1d0ebf86 req-dd5f2a18-ce0d-40c8-b713-cb3523b7accf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60622d10-a64b-42d5-ae5c-841851ace75f", "name": "network-vif-deleted", "tag": "35274d2a-2c83-4e9f-a67f-194267853643"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:11.207929 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a9abfb8b-51ad-4318-ac1c-855c1d0ebf86 req-dd5f2a18-ce0d-40c8-b713-cb3523b7accf service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.208430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a9abfb8b-51ad-4318-ac1c-855c1d0ebf86 req-dd5f2a18-ce0d-40c8-b713-cb3523b7accf service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.220300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-a9abfb8b-51ad-4318-ac1c-855c1d0ebf86 req-dd5f2a18-ce0d-40c8-b713-cb3523b7accf service nova] Creating event network-vif-deleted:35274d2a-2c83-4e9f-a67f-194267853643 for instance 60622d10-a64b-42d5-ae5c-841851ace75f on hv-cinder-79760 Jun 02 13:38:11.226126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-a9abfb8b-51ad-4318-ac1c-855c1d0ebf86 req-dd5f2a18-ce0d-40c8-b713-cb3523b7accf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Jun 02 13:38:11.226768 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 666/1285] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:11.962636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:11.962636 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:11.970922 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.971376 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.972255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.972666 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:12.008333 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:12.008778 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:12.009233 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'fault' on Instance uuid 60622d10-a64b-42d5-ae5c-841851ace75f {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:38:12.066411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:12.066411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-66562f4a-4728-4b9e-b397-42559bf2e5a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 200 len: 1332 microversion: 2.1 time: 0.106570 Jun 02 13:38:12.066411 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 620/1286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:11 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:13.083002 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:13.083604 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:13.090288 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:13.090738 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:13.091522 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:13.091991 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:13.106904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f HTTP/1.1 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:38:13.108630 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:38:13.110597 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '60622d10-a64b-42d5-ae5c-841851ace75f'} Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:38:13.111820 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:38:13.113539 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:38:13.115074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:38:13.115074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cec1a7ee-8e35-46f9-a188-d5adb342fc18 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 404 len: 111 microversion: 2.1 time: 0.032985 Jun 02 13:38:13.115074 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 667/1287] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:13 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:38:13.119178 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4d9c414d-7227-4419-bbe5-8fc50f690e6f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '.version_select at 0x7f5a856ddf70>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:13.200003 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4d9c414d-7227-4419-bbe5-8fc50f690e6f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867753402" status: 202 len: 0 microversion: 2.1 time: 0.084566 Jun 02 13:38:13.200587 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 621/1288] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 2 13:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867753402 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:38:14.013909 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5679e964-93cb-4c03-81ba-f4ec38b744de tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: .version_select at 0x7f5a73e1baf0>, body: {"keypair": {"name": "tempest-keypair-1048374644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOAHCH6sDwW31SuQ7szb/JyHK/+wdB3SYA381V/sQQNEz6iG/ZYMcVv6Ki43DWht1I5Cq9ozarhVem4B02lxTckUINnXckaFobZlfIuIyz0Y8ERZsmzsPjdSsQOqdQ3mQ=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:14.027944 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-5679e964-93cb-4c03-81ba-f4ec38b744de tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:14.033565 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-5679e964-93cb-4c03-81ba-f4ec38b744de tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:14.172018 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5679e964-93cb-4c03-81ba-f4ec38b744de tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161867 Jun 02 13:38:14.172713 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 668/1289] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 2 13:38:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:16.772472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1270903304", "imageRef": "873ff5f9-7623-47e2-98a0-0689c0a857a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a773856c-12bb-470d-ae6c-e26b05167e80"}], "security_groups": [{"name": "tempest-securitygroup--1584271146"}], "key_name": "tempest-keypair-1048374644", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:16.873696 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] validate_networks() for [('a773856c-12bb-470d-ae6c-e26b05167e80', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:38:17.289809 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:38:17.290239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:38:17.290715 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:38:17.291161 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:38:17.291575 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:38:17.301577 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.302028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.302829 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.303269 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.320324 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:17.324421 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Getting quotas for user a3db71a87efc459b8617e9632fcd59e6 and project 7e67e4d57a904f8eb14d2e8b8100cef1. Resources: {'instances', 'cores', 'ram'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:17.336152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:38:17.338445 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='873ff5f9-7623-47e2-98a0-0689c0a857a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:38:17.455541 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a0f1d4e0-57ad-49e7-8e68-f43e58d6d668 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688477 Jun 02 13:38:17.456232 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 622/1290] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 2 13:38:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:38:17.466675 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9099f120-aceb-4374-869e-a655b1fbf5bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:17.467283 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9099f120-aceb-4374-869e-a655b1fbf5bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:17.524562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9099f120-aceb-4374-869e-a655b1fbf5bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:17.531540 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9099f120-aceb-4374-869e-a655b1fbf5bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1242 microversion: 2.1 time: 0.069206 Jun 02 13:38:17.532193 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 669/1291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:17 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:18.550185 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:18.550801 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:18.557028 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.557473 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.558239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.558672 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.621184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:18.629343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7a019196-830e-4e30-a443-ad027ed7f1f0 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1246 microversion: 2.1 time: 0.084108 Jun 02 13:38:18.629914 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 623/1292] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:18 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:19.647185 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:19.648014 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:19.654882 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.655333 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:19.656148 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.656589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:19.719348 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:19.727017 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a4a4ae5c-7a20-45f4-a540-0bd5d6488a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1294 microversion: 2.1 time: 0.083870 Jun 02 13:38:19.727590 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 670/1293] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:19 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:20.746156 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:20.746806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:20.753532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:20.753978 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:20.754730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:20.755165 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:20.819536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:20.827363 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a0f59123-7316-485a-bd23-cdab0961e027 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1300 microversion: 2.1 time: 0.084866 Jun 02 13:38:20.827967 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 624/1294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:20 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:21.845652 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:21.846319 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:21.852851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.853295 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:21.854107 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.854489 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:22.005141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-6e52b778-fb32-423d-8c1f-ce6ae36589d4 req-a716b05c-dcc4-4e3b-8b8c-a39030b0092f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839b4884-53c3-4056-8dab-2d295122c0d9", "tag": "d9d1a676-304b-4747-b554-2855e990ece1"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:22.015247 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-6e52b778-fb32-423d-8c1f-ce6ae36589d4 req-a716b05c-dcc4-4e3b-8b8c-a39030b0092f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:22.015691 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-6e52b778-fb32-423d-8c1f-ce6ae36589d4 req-a716b05c-dcc4-4e3b-8b8c-a39030b0092f service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:22.027125 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-6e52b778-fb32-423d-8c1f-ce6ae36589d4 req-a716b05c-dcc4-4e3b-8b8c-a39030b0092f service nova] Creating event network-changed:d9d1a676-304b-4747-b554-2855e990ece1 for instance 839b4884-53c3-4056-8dab-2d295122c0d9 on hv-cinder-79760 Jun 02 13:38:22.032851 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-6e52b778-fb32-423d-8c1f-ce6ae36589d4 req-a716b05c-dcc4-4e3b-8b8c-a39030b0092f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Jun 02 13:38:22.033781 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 625/1295] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:22.063220 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:22.076133 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a118b4fc-1b67-4ee7-b5bf-8b04e63744d1 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.234741 Jun 02 13:38:22.077570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 671/1296] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:21 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:23.094516 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:23.095342 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:23.102076 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.102528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.103322 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.103763 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.241760 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:23.249249 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11cd79ae-b3bf-4f87-b825-c158a4c2d66d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.159589 Jun 02 13:38:23.249825 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 626/1297] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:23 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:24.265971 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:24.266594 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:24.274240 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.274678 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.275747 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.276207 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.407430 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:24.414819 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2999adda-b020-40d9-a2be-39f9948271bf tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.152818 Jun 02 13:38:24.415374 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 672/1298] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:24 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:25.432572 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:25.433168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:25.440287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.440734 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.441498 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.442019 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.571530 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:25.580295 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3978675f-1a7b-421e-9ee6-1aa2b17f8d98 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.150904 Jun 02 13:38:25.580874 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 627/1299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:25 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:26.597717 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:26.598316 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:26.604830 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:26.605272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:26.606048 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:26.606474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:26.737188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:26.744708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-75028fa9-675e-4c1c-b400-6f08892f1e63 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.151479 Jun 02 13:38:26.745270 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 673/1300] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:26 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:27.761381 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:27.764416 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:27.764737 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:27.765536 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:27.770310 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.770746 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.771521 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.771957 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.902490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:27.910586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7f8e981b-de0c-4c3c-85ab-da2007e54a89 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.153126 Jun 02 13:38:27.911155 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 628/1301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:27 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:28.037435 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-f5582cbd-3532-4db3-b8b4-580464ade1c5 req-b92578b5-8e6e-49ca-a2d0-6001cfaf5f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b4884-53c3-4056-8dab-2d295122c0d9", "name": "network-vif-plugged", "status": "completed", "tag": "d9d1a676-304b-4747-b554-2855e990ece1"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:28.047441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:28.047441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f5582cbd-3532-4db3-b8b4-580464ade1c5 req-b92578b5-8e6e-49ca-a2d0-6001cfaf5f12 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.047441 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f5582cbd-3532-4db3-b8b4-580464ade1c5 req-b92578b5-8e6e-49ca-a2d0-6001cfaf5f12 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.060048 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-f5582cbd-3532-4db3-b8b4-580464ade1c5 req-b92578b5-8e6e-49ca-a2d0-6001cfaf5f12 service nova] Creating event network-vif-plugged:d9d1a676-304b-4747-b554-2855e990ece1 for instance 839b4884-53c3-4056-8dab-2d295122c0d9 on hv-cinder-79760 Jun 02 13:38:28.067063 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-f5582cbd-3532-4db3-b8b4-580464ade1c5 req-b92578b5-8e6e-49ca-a2d0-6001cfaf5f12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032716 Jun 02 13:38:28.067683 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 674/1302] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:28.927169 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:28.927799 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:28.930270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:28.935081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.935525 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.936340 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.936768 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.940065 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:29.072494 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:29.080109 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f643eb5-4fa7-415a-8014-be9e93ae4e38 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.157384 Jun 02 13:38:29.080682 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 629/1303] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:28 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:30.097901 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:30.098589 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:30.109134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:30.109983 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:30.111456 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:30.112290 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:30.253854 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:30.261396 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0ddbfe21-c5db-4e0f-aa75-19ae2be9979a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1368 microversion: 2.1 time: 0.168204 Jun 02 13:38:30.261954 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 675/1304] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:30 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:31.279206 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:31.279859 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:31.288188 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.288632 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.289392 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.289826 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.420487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:31.428088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-39c0867a-f2b8-478e-97c6-a6903161f88f tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1558 microversion: 2.1 time: 0.153113 Jun 02 13:38:31.428676 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 630/1305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:31 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:31.444741 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:31.445506 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:31.452743 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.453212 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.454528 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.454960 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.533507 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c47ead5c-52fa-46e2-8765-a211021b72d7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092607 Jun 02 13:38:31.534110 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 676/1306] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 2 13:38:31 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:32.864624 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-3bec938c-0ed0-46cb-9134-575e75e63878 req-11a7988a-78b9-4da8-b593-386ffa69c8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839b4884-53c3-4056-8dab-2d295122c0d9", "tag": "d9d1a676-304b-4747-b554-2855e990ece1"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:32.875025 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-3bec938c-0ed0-46cb-9134-575e75e63878 req-11a7988a-78b9-4da8-b593-386ffa69c8a0 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:32.875850 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-3bec938c-0ed0-46cb-9134-575e75e63878 req-11a7988a-78b9-4da8-b593-386ffa69c8a0 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:32.888092 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-3bec938c-0ed0-46cb-9134-575e75e63878 req-11a7988a-78b9-4da8-b593-386ffa69c8a0 service nova] Creating event network-changed:d9d1a676-304b-4747-b554-2855e990ece1 for instance 839b4884-53c3-4056-8dab-2d295122c0d9 on hv-cinder-79760 Jun 02 13:38:32.894988 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-3bec938c-0ed0-46cb-9134-575e75e63878 req-11a7988a-78b9-4da8-b593-386ffa69c8a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Jun 02 13:38:32.895897 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 631/1307] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:59.332666 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:38:59.333315 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:39:47.950067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:47.950822 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:47.955086 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:47.955580 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:47.961832 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:47.962935 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:47.966520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:47.966520 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:47.987329 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-76e17e6c-729e-48dd-a0de-0beff21ba0a7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/ips" status: 200 len: 150 microversion: 2.1 time: 0.039375 Jun 02 13:39:47.987896 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 677/1308] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 2 13:39:47 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:50.706657 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=13 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:50.707713 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=5 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:50.712260 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb90f14-0c05-443e-81cd-60ca71237b00"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:50.719747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:50.719747 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:50.720095 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:50.720769 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:50.721136 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:51.742727 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fa1f5e08-8392-413e-8aef-86a3e5a71a0a tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "POST /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037782 Jun 02 13:39:51.743439 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 632/1309] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 2 13:39:50 2022] POST /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:59.342780 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:59.343312 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:59.351022 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.351465 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.352246 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.352681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.432644 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'services' on Instance uuid 839b4884-53c3-4056-8dab-2d295122c0d9 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:39:59.915410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2f08c805-3c46-4498-b445-a1b87be0b3ae tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments/2fb90f14-0c05-443e-81cd-60ca71237b00" status: 202 len: 0 microversion: 2.1 time: 0.576093 Jun 02 13:39:59.916019 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 678/1310] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 2 13:39:59 2022] DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments/2fb90f14-0c05-443e-81cd-60ca71237b00 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:39:59.925244 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:59.926305 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:59.933270 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.933714 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.934446 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.934872 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.963485 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dde8b84b-9a2f-4b58-b2a9-7d9356236538 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jun 02 13:39:59.964123 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 633/1311] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:39:59 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:00.976306 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:00.977219 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:00.984093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:00.984543 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:00.985298 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:00.985762 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:01.015353 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6f7b8018-82f7-47b2-99a4-216828f9cb5d tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Jun 02 13:40:01.015925 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 679/1312] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:00 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:02.027772 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:02.028787 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:02.035434 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.035895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.036653 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.037086 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.064833 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a1a8b563-5862-406c-8df2-09b448cbcaed tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041676 Jun 02 13:40:02.065319 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 634/1313] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:02 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:40:02.121871 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:02.122392 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:02.128803 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.129278 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.130039 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.130478 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.156322 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:40:02.487142 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5696995e-9327-41d7-871e-f68da89a6e52 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 204 len: 0 microversion: 2.1 time: 0.368796 Jun 02 13:40:02.487708 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 680/1314] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:02 2022] DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:40:02.499810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:02.500454 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:02.506744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.507184 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.507952 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.508398 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.641924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:02.649779 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d5ba8905-73f5-44a5-ba6a-f9d8754586fc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1683 microversion: 2.1 time: 0.153479 Jun 02 13:40:02.650281 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 635/1315] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:02 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:03.667796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:03.668474 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:03.674900 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:03.675345 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:03.676134 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:03.676570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:03.810179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:03.817598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8ff1762e-17f4-4650-abf9-505dce8012da tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1683 microversion: 2.1 time: 0.154755 Jun 02 13:40:03.818188 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 681/1316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:03 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:04.834944 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:04.835550 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:04.842795 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:04.843235 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:04.844105 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:04.844532 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:04.906761 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:04.914706 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d0c66ebf-17c4-48a7-b116-29127eb21fb7 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1615 microversion: 2.1 time: 0.083597 Jun 02 13:40:04.915289 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 636/1317] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:04 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:05.201425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-aa559975-9648-44d5-855c-c3b29200722e req-b452ea30-b7c3-4f2f-b40a-7e74ad661877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b4884-53c3-4056-8dab-2d295122c0d9", "name": "network-vif-deleted", "tag": "d9d1a676-304b-4747-b554-2855e990ece1"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:05.201425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-aa559975-9648-44d5-855c-c3b29200722e req-b452ea30-b7c3-4f2f-b40a-7e74ad661877 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.201425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-aa559975-9648-44d5-855c-c3b29200722e req-b452ea30-b7c3-4f2f-b40a-7e74ad661877 service nova] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.201425 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-aa559975-9648-44d5-855c-c3b29200722e req-b452ea30-b7c3-4f2f-b40a-7e74ad661877 service nova] Creating event network-vif-deleted:d9d1a676-304b-4747-b554-2855e990ece1 for instance 839b4884-53c3-4056-8dab-2d295122c0d9 on hv-cinder-79760 Jun 02 13:40:05.204497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-aa559975-9648-44d5-855c-c3b29200722e req-b452ea30-b7c3-4f2f-b40a-7e74ad661877 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094747 Jun 02 13:40:05.204497 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 682/1318] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 2 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:05.933810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:05.934426 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:05.940906 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.941410 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.942272 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.942800 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.980285 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.980730 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.981276 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lazy-loading 'fault' on Instance uuid 839b4884-53c3-4056-8dab-2d295122c0d9 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:40:06.022496 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3db71a87efc459b8617e9632fcd59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67e4d57a904f8eb14d2e8b8100cef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:06.030088 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6e5ff06b-4011-40e5-aacf-b2fdaee5b966 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 200 len: 1332 microversion: 2.1 time: 0.100822 Jun 02 13:40:06.038517 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 637/1319] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:05 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:07.049261 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:07.049966 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:07.056203 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:07.056648 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:07.057400 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:07.057828 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:07.070761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 HTTP/1.1 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:40:07.072389 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:07.075047 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '839b4884-53c3-4056-8dab-2d295122c0d9'} Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:07.076116 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:07.077802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:07.079401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:07.079401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6fbc0f6d-28a9-40b1-9d49-26bb0ceeb30c tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 404 len: 111 microversion: 2.1 time: 0.029952 Jun 02 13:40:07.079401 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 683/1320] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:07 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:07.083528 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3de7e72f-1cb5-4824-b0f2-5654f02efb3e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '.version_select at 0x7f5a85706310>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:07.179093 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3de7e72f-1cb5-4824-b0f2-5654f02efb3e tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048374644" status: 202 len: 0 microversion: 2.1 time: 0.099320 Jun 02 13:40:07.179671 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 638/1321] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 2 13:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048374644 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:09.223032 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:09.223576 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:09.230067 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.230513 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.231272 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.231705 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.244706 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 HTTP/1.1 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:40:09.246225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.248530 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '839b4884-53c3-4056-8dab-2d295122c0d9'} Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:09.249463 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.251076 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.252750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:09.252750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-42465fbe-379c-4633-8f8c-89ecf95377ea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 404 len: 111 microversion: 2.1 time: 0.028987 Jun 02 13:40:09.252750 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 684/1322] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:09 2022] DELETE /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:09.256845 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:09.257484 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 839b4884-53c3-4056-8dab-2d295122c0d9] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:09.265174 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.265621 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.266375 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.266810 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.279518 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 HTTP/1.1 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:40:09.281168 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.282866 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '839b4884-53c3-4056-8dab-2d295122c0d9'} Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:09.283939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. Jun 02 13:40:09.285507 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:09.286924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 839b4884-53c3-4056-8dab-2d295122c0d9 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:09.286924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-835fec12-41ef-4caa-b61b-e135b0d6de43 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9" status: 404 len: 111 microversion: 2.1 time: 0.029718 Jun 02 13:40:09.286924 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 639/1323] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:09 2022] GET /compute/v2.1/servers/839b4884-53c3-4056-8dab-2d295122c0d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:10.570802 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:10.571292 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:10.578782 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.579225 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.580009 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.580439 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.593250 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f HTTP/1.1 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:40:10.594761 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.596480 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '60622d10-a64b-42d5-ae5c-841851ace75f'} Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:10.597339 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.598676 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.600111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:10.600111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0703c017-a7c9-4f20-9ca4-b7929ec0a541 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 404 len: 111 microversion: 2.1 time: 0.029153 Jun 02 13:40:10.600111 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 685/1324] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:10 2022] DELETE /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:10.604648 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:10.605288 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 60622d10-a64b-42d5-ae5c-841851ace75f] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:10.611785 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.612287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.613044 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.613490 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.627150 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f HTTP/1.1 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:40:10.629070 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.630806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '60622d10-a64b-42d5-ae5c-841851ace75f'} Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:10.631962 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. Jun 02 13:40:10.633744 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.635141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 60622d10-a64b-42d5-ae5c-841851ace75f could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:10.635141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eba5eb87-588f-45b5-841a-4262c2b0daea tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jun 02 13:40:10.635141 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 640/1325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:10 2022] GET /compute/v2.1/servers/60622d10-a64b-42d5-ae5c-841851ace75f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:10.640927 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:10.641417 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:10.647440 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.647829 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.648609 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.649039 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.662177 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 HTTP/1.1 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:40:10.663677 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.665382 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': 'e2fb338d-8340-4489-8034-41952c9ec287'} Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:10.666330 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.668007 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.669601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:10.669601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8b1f8912-b459-41be-9207-9bde2d0639ca tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 404 len: 111 microversion: 2.1 time: 0.028576 Jun 02 13:40:10.669601 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 686/1326] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:10 2022] DELETE /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:10.673289 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:10.673895 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: e2fb338d-8340-4489-8034-41952c9ec287] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:10.679806 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.680287 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.681031 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.681457 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.695182 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 HTTP/1.1 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:40:10.696699 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.698448 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': 'e2fb338d-8340-4489-8034-41952c9ec287'} Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:10.699605 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. Jun 02 13:40:10.701846 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:10.703313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance e2fb338d-8340-4489-8034-41952c9ec287 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:10.703313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8285ceaf-a682-4724-b292-42bffc46e514 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287" status: 404 len: 111 microversion: 2.1 time: 0.028730 Jun 02 13:40:10.703313 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 641/1327] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:10 2022] GET /compute/v2.1/servers/e2fb338d-8340-4489-8034-41952c9ec287 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:40:12.004617 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:12.005126 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:12.011598 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.012093 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.012855 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.013920 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.027162 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 HTTP/1.1 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept: application/json Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Connection: close Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Length: 0 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Content-Type: application/json Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Host: 10.222.0.46 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Role: member,reader Jun 02 13:40:12.028726 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Roles: member,reader Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: method: > Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: exception: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.030187 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: action_args: {'id': '9ae99ef6-c65f-4b4e-81b2-33317c2244c0'} Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:12.031095 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.032894 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.034617 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:12.034617 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c97f3de0-5776-4724-9f17-8ea5befe1cdc tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 404 len: 111 microversion: 2.1 time: 0.029686 Jun 02 13:40:12.034617 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 687/1328] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:11 2022] DELETE /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:40:12.038637 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:12.043316 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] [instance: 9ae99ef6-c65f-4b4e-81b2-33317c2244c0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:12.045941 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.046394 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.047152 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.047592 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Lock "1df06762-053d-4fa1-85a6-089ccc3e3199" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.061330 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] HTTP exception thrown: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Request method failure captured: Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 HTTP/1.1 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept: application/json Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Connection: close Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Length: 0 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Content-Type: application/json Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Host: 10.222.0.46 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABimLv7apjs6I_MinB2QV0-skAzULHsrHamxmVsbGBSVK5IFB6DYZv0PDRO6zcrZo2txsX_fSYeQxYr8uI8TKvHqecSlEnXW3nX0bJDNRnP9YUQMmAhr7iQ0kP84F9FBYl0NNw01oXtoXoliS0fDlw88AcenGeUjTv6066bSUYVlyGW9k0 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Id: None Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Domain-Name: None Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Role: member,reader Jun 02 13:40:12.062868 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Roles: member,reader Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e67e4d57a904f8eb14d2e8b8100cef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e67e4d57a904f8eb14d2e8b8100cef1"}]}] Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 7e67e4d57a904f8eb14d2e8b8100cef1 Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1984324947 Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Id: a3db71a87efc459b8617e9632fcd59e6 Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1984324947-project Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: method: > Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: exception: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.064546 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: action_args: {'id': '9ae99ef6-c65f-4b4e-81b2-33317c2244c0'} Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:12.065688 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. Jun 02 13:40:12.067831 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Jun 02 13:40:12.069565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] Returning 404 to user: Instance 9ae99ef6-c65f-4b4e-81b2-33317c2244c0 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:12.069565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-42625595-7393-4d81-84be-3a175ce33f22 tempest-AttachVolumeNegativeTest-1984324947 tempest-AttachVolumeNegativeTest-1984324947-project] 10.222.0.46 "GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0" status: 404 len: 111 microversion: 2.1 time: 0.029503 Jun 02 13:40:12.069565 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 642/1329] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:12 2022] GET /compute/v2.1/servers/9ae99ef6-c65f-4b4e-81b2-33317c2244c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:17.584081 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:40:17.584677 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:40:19.791091 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6a671a28-c35a-43b3-a664-d8b6ee4d5083 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a73712820>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:19.838681 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6a671a28-c35a-43b3-a664-d8b6ee4d5083 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/06d15ee7-62b7-4718-a0fe-50738631f340" status: 200 len: 351 microversion: 2.1 time: 0.051310 Jun 02 13:40:19.839242 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 688/1330] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:40:19 2022] GET /compute/v2.1/os-volumes/06d15ee7-62b7-4718-a0fe-50738631f340 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:21.434951 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0ae4f6cf-82a2-4d3d-86a1-33ceca7e1045 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a856ffc10>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:21.481912 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0ae4f6cf-82a2-4d3d-86a1-33ceca7e1045 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ebd97339-d4b2-4f7f-9573-523ad520096d" status: 200 len: 351 microversion: 2.1 time: 0.050677 Jun 02 13:40:21.482472 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 643/1331] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:40:21 2022] GET /compute/v2.1/os-volumes/ebd97339-d4b2-4f7f-9573-523ad520096d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:23.205197 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:23.205993 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:23.209796 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ffacf51c-fa76-48a2-9a3c-93e73b044273 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a737160d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.256904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ffacf51c-fa76-48a2-9a3c-93e73b044273 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ca75efec-7d38-4bc6-aecd-875e1bbaf1b2" status: 200 len: 350 microversion: 2.1 time: 0.053071 Jun 02 13:40:23.257584 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 689/1332] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes/ca75efec-7d38-4bc6-aecd-875e1bbaf1b2 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:23.265580 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:23.266346 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:23.270586 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3d026fe3-9ef4-4e03-903b-b755b636a132 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a856c7550>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.351075 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3d026fe3-9ef4-4e03-903b-b755b636a132 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086316 Jun 02 13:40:23.351640 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 644/1333] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:23.364570 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4fce4239-4a04-477e-989f-9926762f0ec8 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a7372adc0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.446282 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4fce4239-4a04-477e-989f-9926762f0ec8 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085913 Jun 02 13:40:23.446851 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 690/1334] 10.222.0.46 () {58 vars in 1148 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:40:23.458818 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-edce5709-04c5-4223-9da4-d8f7b8dab4c7 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a856ca1f0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.540173 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-edce5709-04c5-4223-9da4-d8f7b8dab4c7 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085077 Jun 02 13:40:23.541558 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 645/1335] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:23.551667 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f784d622-4ac0-4b3e-bf37-db0e8f4ad3cf tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a73712f70>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.631562 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f784d622-4ac0-4b3e-bf37-db0e8f4ad3cf tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083665 Jun 02 13:40:23.632191 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 691/1336] 10.222.0.46 () {58 vars in 1166 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:23.644151 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-998062c6-7152-4c60-9e93-cc69810a74e5 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a8577b0d0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.724669 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-998062c6-7152-4c60-9e93-cc69810a74e5 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084295 Jun 02 13:40:23.725239 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 646/1337] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:23.737410 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31e6bb49-ae5a-4afd-8a71-93c23ac12356 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a7373b1f0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.818213 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31e6bb49-ae5a-4afd-8a71-93c23ac12356 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084477 Jun 02 13:40:23.818785 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 692/1338] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:23.830733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2a1e6f59-14e2-424c-a74a-7330fff8c140 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a856c71f0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:23.911939 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2a1e6f59-14e2-424c-a74a-7330fff8c140 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085512 Jun 02 13:40:23.917343 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 647/1339] 10.222.0.46 () {58 vars in 1187 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:23.924205 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-02340917-a7ff-43d5-9e95-a2af40bfe603 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] Calling method '.version_select at 0x7f5a737f6790>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:24.004614 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-02340917-a7ff-43d5-9e95-a2af40bfe603 tempest-VolumesTestJSON-856390636 tempest-VolumesTestJSON-856390636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084256 Jun 02 13:40:24.005179 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 693/1340] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Jun 2 13:40:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:19.340567 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:42:19.341300 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:42:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:43:37.592931 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:43:37.593487 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:43:51.382800 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:43:51.383366 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:45:29.154248 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:45:29.154875 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:45:38.628255 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:45:38.628960 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:45:39.349303 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:45:39.349904 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:45:48.050628 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:45:48.051413 dv-cinder-797608-26-iscsi devstack@n-api.service[118132]: Thu Jun 2 13:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:46:57.600733 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:46:57.601378 dv-cinder-797608-26-iscsi devstack@n-api.service[118131]: Thu Jun 2 13:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!